Add Quants (#2)

- Add Quants (33a4e0f5e5a43d25d587c8426a2f8fb35dc95321)


Co-authored-by: Bartowski <[email protected]>

README.md

@@ -40,6 +40,12 @@ The `Locutusque/NeuralHyperion-2.0-Mistral-7B` model was fine-tuned on 1,550,000
 ## Evaluation Results
 Coming soon.  
 
+## Quants
+
+ExLlamaV2: https://huggingface.co/bartowski/NeuralHyperion-2.0-Mistral-7B-exl2
+
+GGUF: https://huggingface.co/bartowski/NeuralHyperion-2.0-Mistral-7B-GGUF
+
 ## How to Use
 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer