Spaces:

Azure99
/

Blossom-9B-Demo

Running on Zero

Azure99 commited on Jul 24

Commit

12b1da7

•

1 Parent(s): 3314649

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -9,7 +9,7 @@ MAX_INPUT_LIMIT = 3584
 MAX_NEW_TOKENS = 1536
 MODEL_NAME = "Azure99/blossom-v5.1-9b"
-model = AutoModelForCausalLM.from_pretrained(MODEL_NAME, torch_dtype=torch.float16, device_map="auto")
 tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME)

 MAX_NEW_TOKENS = 1536
 MODEL_NAME = "Azure99/blossom-v5.1-9b"
+model = AutoModelForCausalLM.from_pretrained(MODEL_NAME, torch_dtype=torch.bfloat16, device_map="auto")
 tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME)