Hugging Face's logo

MatrixC7
/
karakuri-lm-70b-v0.1-exl2

Text Generation
Japanese
English
llama
llama-2
Model card Files Community
1
MatrixC7 commited on
Commit
54fef78
·
verified ·
1 Parent(s): 7665a56

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -10
README.md CHANGED
@@ -23,13 +23,16 @@ The measurement file is attached in the branch `main` and all quants are stored
23
 
24
  The chart below presents the calibration perplexity and [wikitext-103-v1](https://huggingface.co/datasets/wikitext) test perplexity for all provided quants.
25
 
26
- | Quant | Calibration Perplexity | wikitext-103-v1 Test Perplexity |
27
- |-----------------------------------------------------------------------------------------|------------------------|---------------------------------|
28
- | [2.4bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/2.4bpw-h6) | 8.4726 | 7.1337 |
29
- | [2.65bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/2.65bpw-h6) | 8.0901 | 6.5724 |
30
- | [3.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/3.0bpw-h6) | 7.9927 | 6.4607 |
31
- | [4.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/4.0bpw-h6) | 7.6440 | 5.8014 |
32
- | [4.65bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/4.65bpw-h6) | 7.5872 | 5.7112 |
33
- | [5.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/5.0bpw-h6) | 7.5745 | |
34
- | [6.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/6.0bpw-h6) | 7.5616 | |
35
- | [8.0bpw-h8](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/8.0bpw-h8) | 7.5604 | |
 
 
 
 
23
 
24
  The chart below presents the calibration perplexity and [wikitext-103-v1](https://huggingface.co/datasets/wikitext) test perplexity for all provided quants.
25
 
26
+ | Quant | Calibration Perplexity | wikitext-103-v1 Test Perplexity |
27
+ |------------------------------------------------------------------------------------------|------------------------|---------------------------------|
28
+ | [2.4bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/2.4bpw-h6) | 8.4726 | 7.1337 |
29
+ | ~[2.65bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/2.65bpw-h6)~* | ~8.1743~ | ~8.7475~ |
30
+ | [2.65bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/2.65bpw-h6) | 8.0901 | 6.5724 |
31
+ | [3.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/3.0bpw-h6) | 7.9927 | 6.4607 |
32
+ | [4.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/4.0bpw-h6) | 7.6440 | 5.8014 |
33
+ | [4.65bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/4.65bpw-h6) | 7.5872 | 5.7112 |
34
+ | [5.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/5.0bpw-h6) | 7.5745 | |
35
+ | [6.0bpw-h6](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/6.0bpw-h6) | 7.5616 | |
36
+ | [8.0bpw-h8](https://huggingface.co/MatrixC7/karakuri-lm-70b-v0.1-exl2/tree/8.0bpw-h8) | 7.5604 | |
37
+
38
+ *: This first version has been deprecated due to unexpectedly high wikitext-103-v1 Test Perplexity values.