Spaces:

xu-song
/

tokenizer-arena

Running

App Files Files Community

tokenizer-arena / requirements.txt

xu-song's picture

requi

510279b 8 months ago

94 Bytes

	transformers==4.38.0
	sentencepiece
	tiktoken
	icetk
	torch==2.2.0
	zhon
	nltk
	boto3
	ai2-olmo==0.2.4