Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
PrunaAI
/
scb10x-typhoon-7b-QUANTO-float8bit-smashed
like
0
Follow
Pruna AI
297
Pruna AI
Model card
Files
Files and versions
xet
Community
1
Use this model
f9d567a
scb10x-typhoon-7b-QUANTO-float8bit-smashed
14.5 GB
1 contributor
History:
3 commits
sharpenb
766cea77104a19eaff2c89d95d51a196cc6f6c53e01e6d1f3420e0480c6ed086
f9d567a
verified
about 1 year ago
.gitattributes
Safe
1.52 kB
initial commit
about 1 year ago
README.md
Safe
5.3 kB
766cea77104a19eaff2c89d95d51a196cc6f6c53e01e6d1f3420e0480c6ed086
about 1 year ago
config.json
Safe
0 Bytes
766cea77104a19eaff2c89d95d51a196cc6f6c53e01e6d1f3420e0480c6ed086
about 1 year ago
model.pt
pickle
Detected Pickle imports (23)
"torch.device"
,
"transformers.models.mistral.modeling_mistral.MistralDecoderLayer"
,
"collections.OrderedDict"
,
"torch.FloatStorage"
,
"torch.bfloat16"
,
"transformers.models.mistral.modeling_mistral.MistralSdpaAttention"
,
"transformers.models.mistral.configuration_mistral.MistralConfig"
,
"quanto.nn.qlinear.QLinear"
,
"torch.nn.modules.container.ModuleList"
,
"torch.BFloat16Storage"
,
"transformers.models.mistral.modeling_mistral.MistralMLP"
,
"transformers.models.mistral.modeling_mistral.MistralRMSNorm"
,
"torch.float8_e4m3fn"
,
"torch.nn.modules.sparse.Embedding"
,
"__builtin__.set"
,
"torch._utils._rebuild_parameter"
,
"transformers.generation.configuration_utils.GenerationConfig"
,
"torch._utils._rebuild_tensor_v2"
,
"transformers.models.mistral.modeling_mistral.MistralForCausalLM"
,
"transformers.models.mistral.modeling_mistral.MistralModel"
,
"quanto.tensor.qtype.qtype"
,
"transformers.models.mistral.modeling_mistral.MistralRotaryEmbedding"
,
"torch.nn.modules.activation.SiLU"
How to fix it?
14.5 GB
xet
c382464f01be8b41f44f1c260e98c00d698191f0e97269c320014c9bdc093efc
about 1 year ago
smash_config.json
Safe
1.02 kB
766cea77104a19eaff2c89d95d51a196cc6f6c53e01e6d1f3420e0480c6ed086
about 1 year ago
special_tokens_map.json
Safe
414 Bytes
766cea77104a19eaff2c89d95d51a196cc6f6c53e01e6d1f3420e0480c6ed086
about 1 year ago
tokenizer.json
Safe
1.99 MB
766cea77104a19eaff2c89d95d51a196cc6f6c53e01e6d1f3420e0480c6ed086
about 1 year ago
tokenizer.model
Safe
563 kB
xet
766cea77104a19eaff2c89d95d51a196cc6f6c53e01e6d1f3420e0480c6ed086
about 1 year ago
tokenizer_config.json
Safe
995 Bytes
766cea77104a19eaff2c89d95d51a196cc6f6c53e01e6d1f3420e0480c6ed086
about 1 year ago