jhu-clsp/mmBERT-base
Fill-Mask
•
Updated
•
35.4k
•
•
154
mmBERT: a modern multilingual encoder
mmBERT is trained on 3T tokens from over 1800 languages, showing SoTA scores on benchmarks and exceptional low-resource performance
-
jhu-clsp/mmBERT-small
Fill-Mask • Updated • 6.57k • • 52Note Intermediate checkpoints for continued pre-training (MosiacML Composer format)
jhu-clsp/mmBERT-checkpoints
Updated • 2Note Pre-training Data
-
jhu-clsp/mmBERT-pretrain-p1-fineweb2-langs
Updated • 1.26k • 4 -
jhu-clsp/mmBERT-pretrain-p2-fineweb2-remaining
Updated • 2.91k -
jhu-clsp/mmBERT-pretrain-p3-others
Updated • 26.5k -
jhu-clsp/mmBERT-midtraining-data
Updated • 29.2k • 1
jhu-clsp/mmBERT-decay-data
Updated • 9.26k • 2Note Randomized data for training (not recommended unless you are using the same data mix)
-
orionweller/mmBERT-data-decay-all
Updated • 408 -
orionweller/mmBERT-data-decay-cont
Updated • 264 -
orionweller/mmBERT-data-decay-eng
Updated • 513 -
orionweller/mmBERT-data-midtraining
Updated • 322 -
orionweller/mmBERT-pretraining-data-chunk0
Preview • Updated • 5.54k -
orionweller/mmBERT-pretraining-data-chunk1
Preview • Updated • 2.7k -
orionweller/mmBERT-pretraining-data-chunk2
Preview • Updated • 443 -
orionweller/mmBERT-pretraining-data-chunk3
Preview • Updated • 1.79k