JakeOh
/

gpt2-mlm-tokenizer

Model card Files Files and versions

gpt2-mlm-tokenizer / added_tokens.json

JakeOh's picture

Upload tokenizer

6629507 verified 12 days ago

history blame contribute delete

44 Bytes

	{
	"<\|mask\|>": 50258,
	"<\|pad\|>": 50257
	}