USTC-KnowledgeComputingLab
/

Llama3-KALE-LM-Chem-8B

Text Generation

Model card Files Files and versions Community

KnowledgeComputingLab commited on Oct 29

Commit

40ceb07

•

1 Parent(s): e81c954

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -54,7 +54,7 @@ device = "cuda" # the device to load the model onto
 model = AutoModelForCausalLM.from_pretrained(
     "USTC-KnowledgeComputingLab/Llama3-KALE-LM-Chem-8B",
-    torch_dtype=torch.float16,
     device_map="auto"
 )
 tokenizer = AutoTokenizer.from_pretrained("USTC-KnowledgeComputingLab/Llama3-KALE-LM-Chem-8B")

 model = AutoModelForCausalLM.from_pretrained(
     "USTC-KnowledgeComputingLab/Llama3-KALE-LM-Chem-8B",
+    torch_dtype="auto",
     device_map="auto"
 )
 tokenizer = AutoTokenizer.from_pretrained("USTC-KnowledgeComputingLab/Llama3-KALE-LM-Chem-8B")