ggunio
/

B2NL-v6.1.2

byte-level-tokenization

Model card Files Files and versions

1.2 GB

1 contributor

History: 14 commits

ggunio's picture

Update README.md

17b2417 verified 2 months ago

.gitattributes

1.52 kB

initial commit 2 months ago
README.md

3.27 kB

Update README.md 2 months ago
byte_tokenizer_v6.py

10.2 kB

Upload byte_tokenizer_v6.py with huggingface_hub 2 months ago
config.json

550 Bytes

Upload config.json with huggingface_hub 2 months ago
pytorch_model.bin
Detected Pickle imports (6)
- "numpy.core.multiarray.scalar",
- "numpy.dtype",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "_codecs.encode"
How to fix it?
1.2 GB
xet

Upload pytorch_model.bin with huggingface_hub 2 months ago
unified_model.py

32.5 kB

Upload unified_model.py with huggingface_hub 2 months ago