Spaces:

xu-song
/

tokenizer-arena

Running

App Files Files Community

tokenizer-arena / utils /lang_util.py

xu-song's picture

update

751936e about 1 year ago

27 Bytes

	"""
	日语、韩语等
	"""