radm
/

Athene-V2-Chat-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

radm commited on Mar 17

Commit

c4af684

·

verified ·

1 Parent(s): 53a8a43

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -18,7 +18,7 @@ base_model:
 - AWQ 4bit version of [Nexusflow/Athene-V2-Chat](https://huggingface.co/Nexusflow/Athene-V2-Chat)
 - [Quantization code](https://docs.vllm.ai/en/latest/quantization/auto_awq.html)
-- This model [only fits to 1 gpu](https://huggingface.co/radm/Athene-V2-Chat-AWQ/discussions/2). Use [kosbu/Athene-V2-Chat-AWQ](kosbu/Athene-V2-Chat-AWQ) for multi-gpu support
 ## Eval AWQ version

 - AWQ 4bit version of [Nexusflow/Athene-V2-Chat](https://huggingface.co/Nexusflow/Athene-V2-Chat)
 - [Quantization code](https://docs.vllm.ai/en/latest/quantization/auto_awq.html)
+- This model [only fits to 1 gpu](https://huggingface.co/radm/Athene-V2-Chat-AWQ/discussions/2). Use [kosbu/Athene-V2-Chat-AWQ](https://huggingface.co/kosbu/Athene-V2-Chat-AWQ) for multi-gpu support
 ## Eval AWQ version