Locutusque Kronikus commited on
Commit
d9c137c
1 Parent(s): dce6074

Add AWQ quant links (#3)

Browse files

- Add AWQ quant links (1a3d9f5cd6bb6861ee67ba6164817cbd2ad6b1f0)


Co-authored-by: Joseph David Memphries <[email protected]>

Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -46,6 +46,8 @@ ExLlamaV2: https://huggingface.co/bartowski/NeuralHyperion-2.0-Mistral-7B-exl2
46
 
47
  GGUF: https://huggingface.co/bartowski/NeuralHyperion-2.0-Mistral-7B-GGUF
48
 
 
 
49
  ## How to Use
50
  ```python
51
  from transformers import AutoModelForCausalLM, AutoTokenizer
 
46
 
47
  GGUF: https://huggingface.co/bartowski/NeuralHyperion-2.0-Mistral-7B-GGUF
48
 
49
+ AWQ: https://huggingface.co/solidrust/NeuralHyperion-2.0-Mistral-7B-AWQ
50
+
51
  ## How to Use
52
  ```python
53
  from transformers import AutoModelForCausalLM, AutoTokenizer