Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Hanbaike
/
kyrgyz_spm_tokenizer
like
0
Kyrgyz
kyrgyz
tokenization
sentencepiece
BPE
Unigram
License:
mit
Model card
Files
Files and versions
xet
Community
main
kyrgyz_spm_tokenizer
/
models
16.5 MB
1 contributor
History:
1 commit
Hanbaike
Upload folder using huggingface_hub
17e7017
verified
7 months ago
kyrgyz_bpe_16000.model
Safe
607 kB
xet
Upload folder using huggingface_hub
7 months ago
kyrgyz_bpe_16000.vocab
Safe
358 kB
Upload folder using huggingface_hub
7 months ago
kyrgyz_bpe_24000.model
Safe
811 kB
xet
Upload folder using huggingface_hub
7 months ago
kyrgyz_bpe_24000.vocab
Safe
562 kB
Upload folder using huggingface_hub
7 months ago
kyrgyz_bpe_32000.model
Safe
1.02 MB
xet
Upload folder using huggingface_hub
7 months ago
kyrgyz_bpe_32000.vocab
Safe
770 kB
Upload folder using huggingface_hub
7 months ago
kyrgyz_bpe_4000.model
Safe
317 kB
xet
Upload folder using huggingface_hub
7 months ago
kyrgyz_bpe_4000.vocab
Safe
74.4 kB
Upload folder using huggingface_hub
7 months ago
kyrgyz_bpe_51200.model
Safe
1.53 MB
xet
Upload folder using huggingface_hub
7 months ago
kyrgyz_bpe_51200.vocab
Safe
1.28 MB
Upload folder using huggingface_hub
7 months ago
kyrgyz_bpe_8000.model
Safe
410 kB
xet
Upload folder using huggingface_hub
7 months ago
kyrgyz_bpe_8000.vocab
Safe
163 kB
Upload folder using huggingface_hub
7 months ago
kyrgyz_unigram_16000.model
Safe
635 kB
xet
Upload folder using huggingface_hub
7 months ago
kyrgyz_unigram_16000.vocab
Safe
427 kB
Upload folder using huggingface_hub
7 months ago
kyrgyz_unigram_24000.model
Safe
848 kB
xet
Upload folder using huggingface_hub
7 months ago
kyrgyz_unigram_24000.vocab
Safe
656 kB
Upload folder using huggingface_hub
7 months ago
kyrgyz_unigram_32000.model
Safe
1.06 MB
xet
Upload folder using huggingface_hub
7 months ago
kyrgyz_unigram_32000.vocab
Safe
886 kB
Upload folder using huggingface_hub
7 months ago
kyrgyz_unigram_4000.model
Safe
326 kB
xet
Upload folder using huggingface_hub
7 months ago
kyrgyz_unigram_4000.vocab
Safe
95.3 kB
Upload folder using huggingface_hub
7 months ago
kyrgyz_unigram_51200.model
Safe
1.59 MB
xet
Upload folder using huggingface_hub
7 months ago
kyrgyz_unigram_51200.vocab
Safe
1.45 MB
Upload folder using huggingface_hub
7 months ago
kyrgyz_unigram_8000.model
Safe
425 kB
xet
Upload folder using huggingface_hub
7 months ago
kyrgyz_unigram_8000.vocab
Safe
202 kB
Upload folder using huggingface_hub
7 months ago