internlm2-chat-20b / tokenization_internlm2.py

Commit History

fast tokenizer and stream_chat fix (#7)
d0438da
verified

RangiLyu x54-729 commited on