huihui-ai commited on
Commit
9edff64
1 Parent(s): cd8602f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -28,12 +28,13 @@ You can use this model in your applications by loading it with Hugging Face's `t
28
 
29
  ```python
30
  from transformers import AutoModelForCausalLM, AutoTokenizer
 
31
 
32
  # Load the model and tokenizer
33
  model_name = "huihui-ai/Qwen2.5-Code-32B-Instruct-abliterated"
34
  model = AutoModelForCausalLM.from_pretrained(
35
  model_name,
36
- torch_dtype="auto",
37
  device_map="auto"
38
  )
39
  tokenizer = AutoTokenizer.from_pretrained(model_name)
 
28
 
29
  ```python
30
  from transformers import AutoModelForCausalLM, AutoTokenizer
31
+ import torch
32
 
33
  # Load the model and tokenizer
34
  model_name = "huihui-ai/Qwen2.5-Code-32B-Instruct-abliterated"
35
  model = AutoModelForCausalLM.from_pretrained(
36
  model_name,
37
+ torch_dtype=torch.bfloat16,
38
  device_map="auto"
39
  )
40
  tokenizer = AutoTokenizer.from_pretrained(model_name)