xu-song's picture
add amber and crystal_coder
5db13e0
raw
history blame
192 Bytes
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained(
"LLM360/CrystalCoder",
revision="CrystalCoder_phase1_checkpoint_055500",
trust_remote_code=True
)