Spaces:

yhavinga
/

dutch-tokenizer-arena

Running

dutch-tokenizer-arena / utils /digit_util.py

add compress rate

814ee6b over 1 year ago

50 Bytes

	"""

	qwen segments numbers by single digits.


	"""