THUDM

/

chatglm2-6b-int4

like 236

Follow

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University 1.77k

示例代码里还是THUDM/chatglm2-6b，没有改成chatglm2-6b-int4
tokenizer = AutoTokenizer.from_pretrained("THUDM/chatglm2-6b", trust_remote_code=True)
model = AutoModel.from_pretrained("THUDM/chatglm2-6b", trust_remote_code=True).half().cuda()