The tokenizer adds a special token '<|im_end|>' to solve the problem of non-stop generation when encountering <|im_end|>. a31949e verified zjyhf commited on May 15, 2024
Adding `safetensors` variant of this model (#12) df565a1 verified zihanliu SFconvertbot commited on May 6, 2024