LLM360
/

K2-Chat

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

hunterhector commited on 2 days ago

Commit

fe59027

·

verified ·

1 Parent(s): 58fdb6c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -32,7 +32,7 @@ We utilized the following datasets:
 | LogiQA2.0 (0-shot)      | **38.0**    | 36.83    |
 | BBH CoT (0-shot)        | 64.9    | **70.37**    |
 | **Code Benchmarks**     |         |          |
-| HumanEval (pass@1)      | 47.9    | **71.20**    |
 | **Domain Specific (Medical)** |   |          |
 | MedQA (0-shot)          | **53.6**    | 52.87    |
 | MedMCQA (5-shot)        | **51.3**    | 50.71    |

 | LogiQA2.0 (0-shot)      | **38.0**    | 36.83    |
 | BBH CoT (0-shot)        | 64.9    | **70.37**    |
 | **Code Benchmarks**     |         |          |
+| HumanEval (pass@1)      | 47.9    | **60.82**    |
 | **Domain Specific (Medical)** |   |          |
 | MedQA (0-shot)          | **53.6**    | 52.87    |
 | MedMCQA (5-shot)        | **51.3**    | 50.71    |