InstaDeepAI
/

nucleotide-transformer-v2-100m-multi-species

Model card Files Files and versions

nucleotide-transformer-v2-100m-multi-species / tokenizer_config.json

hdallatorre's picture

Upload tokenizer

4d652e0 over 2 years ago

history blame contribute delete

129 Bytes

	{
	"clean_up_tokenization_spaces": true,
	"eos_token": null,
	"model_max_length": 2048,
	"tokenizer_class": "EsmTokenizer"
	}