abhinavkulkarni
/

psmathur-orca_mini_v2_13b-w4-g128-awq

Text Generation

text-generation-inference

Model card Files Files and versions Community

abhinavkulkarni commited on Jul 10, 2023

Commit

38a756e

•

1 Parent(s): 58fe905

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -61,7 +61,7 @@ q_config = {
     "q_group_size": 128,
 }
-load_quant = snapshot_download('abhinavkulkarni/open-llama-13b-open-instruct-w4-g128-awq')
 with init_empty_weights():
     model = AutoModelForCausalLM.from_config(config=config,

     "q_group_size": 128,
 }
+load_quant = snapshot_download('abhinavkulkarni/psmathur-orca_mini_v2_13b-w4-g128-awq')
 with init_empty_weights():
     model = AutoModelForCausalLM.from_config(config=config,