ggunio
/

B2NL-IntelligentTokenizer-v6.2.1

semantic-boundaries

Model card Files Files and versions

B2NL-IntelligentTokenizer-v6.2.1

1.84 GB

1 contributor

History: 12 commits

ggunio's picture

Update README.md

4df097b verified about 2 months ago

.gradio
Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) about 2 months ago
core
Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) about 2 months ago
.gitattributes

1.52 kB

initial commit about 2 months ago
MODEL_CARD.md

4.75 kB

Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) about 2 months ago
README.md

6.12 kB

Update README.md about 2 months ago
app.py

29.9 kB

Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) about 2 months ago
config.json

515 Bytes

Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) about 2 months ago
config.yaml

6 kB

Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) about 2 months ago
inference.py

6.47 kB

Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) about 2 months ago
model.safetensors

921 MB
xet

Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) about 2 months ago
parallel_inference.py

9.04 kB

Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) about 2 months ago
pytorch_model.bin
Detected Pickle imports (4)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.LongStorage"
What is a pickle import?
922 MB
xet

Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) about 2 months ago
requirements.txt

109 Bytes

Initial upload: B2NL-IntelligentTokenizer v6.2.1 (Autoregressive Mode) about 2 months ago