ISTA-DASLab
/

Phi-3-mini-4k-instruct-AQLM-PV-2Bit-1x16-hf

Text Generation

phi-3-mini-4k-instruct

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

justheuristic commited on May 30

Commit

4968216

•

1 Parent(s): 2bcaf27

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -19,7 +19,7 @@ Results (0-shot `acc`):
 Results:
 | Model      | Quantization | ArcC| ArcE| Hellaswag | PiQA | Winogrande | Model size, Gb |
-|------|------|-------|------|------|------|------|------|------|
 | microsoft/Phi-3-mini-4k-instruct| None | 0.5529 | 0.8325	| 0.6055 | 0.8020 | 0.7364 | 7.6 |
 |  | 1x16 | 0.5051 | 0.7950 | 0.5532 | 0.7949	| 73.01  | 1.4 |

 Results:
 | Model      | Quantization | ArcC| ArcE| Hellaswag | PiQA | Winogrande | Model size, Gb |
+|------|------|-------|------|------|------|------|------|
 | microsoft/Phi-3-mini-4k-instruct| None | 0.5529 | 0.8325	| 0.6055 | 0.8020 | 0.7364 | 7.6 |
 |  | 1x16 | 0.5051 | 0.7950 | 0.5532 | 0.7949	| 73.01  | 1.4 |