ChuckMcSneed commited on
Commit
ce4ebec
·
verified ·
1 Parent(s): 68c75cc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -22,6 +22,7 @@ This is the same model as [cognitivecomputations/dolphin-2.9.1-dbrx](https://hug
22
  # Benchmarks and personal opinion
23
  ### NeoEvalPlusN_benchmark
24
  [My meme benchmark.](https://huggingface.co/datasets/ChuckMcSneed/NeoEvalPlusN_benchmark)
 
25
  |Name |Quant|Size |B |C |D |S |P |total|BCD|SP |
26
  |---------------------------------------------|-----|------|---|---|---|----|----|-----|---|----|
27
  |cognitivecomputations/dolphin-2.9.1-dbrx |Q6_K |16x12B|3 |1 |3 |4 |6 |17 |7 |10 |
@@ -29,6 +30,7 @@ This is the same model as [cognitivecomputations/dolphin-2.9.1-dbrx](https://hug
29
  |databricks/dbrx-instruct |Q6_K |16x12B|0 |0 |0 |6.5 |4.5 |11 |0 |11 |
30
  |cognitivecomputations/dolphin-2.2-70b |Q6_K |70B |0 |1 |1 |4.5 |4.5 |11 |2 |9 |
31
  |Maximum |n/a |n/a |3 |2 |3 |8 |6 |22 |8 |14 |
 
32
  More compliant than the official instruct tune(BCD). To my surprise, performed much better overall than qwen-110b tuned on the same dataset.
33
  Wrote 6 perfect poems(P column), which is **very** unusual.
34
  Only models from goliath family and more recent llama-3-70b-instruct could do that.
 
22
  # Benchmarks and personal opinion
23
  ### NeoEvalPlusN_benchmark
24
  [My meme benchmark.](https://huggingface.co/datasets/ChuckMcSneed/NeoEvalPlusN_benchmark)
25
+
26
  |Name |Quant|Size |B |C |D |S |P |total|BCD|SP |
27
  |---------------------------------------------|-----|------|---|---|---|----|----|-----|---|----|
28
  |cognitivecomputations/dolphin-2.9.1-dbrx |Q6_K |16x12B|3 |1 |3 |4 |6 |17 |7 |10 |
 
30
  |databricks/dbrx-instruct |Q6_K |16x12B|0 |0 |0 |6.5 |4.5 |11 |0 |11 |
31
  |cognitivecomputations/dolphin-2.2-70b |Q6_K |70B |0 |1 |1 |4.5 |4.5 |11 |2 |9 |
32
  |Maximum |n/a |n/a |3 |2 |3 |8 |6 |22 |8 |14 |
33
+
34
  More compliant than the official instruct tune(BCD). To my surprise, performed much better overall than qwen-110b tuned on the same dataset.
35
  Wrote 6 perfect poems(P column), which is **very** unusual.
36
  Only models from goliath family and more recent llama-3-70b-instruct could do that.