|
--- |
|
license: apache-2.0 |
|
--- |
|
|
|
--- |
|
|
|
|
|
base_model: /Users/dawn/git/models/Starling-LM-7B-beta |
|
gate_mode: hidden # one of "hidden", "cheap_embed", or "random" |
|
dtype: bfloat16 # output dtype (float32, float16, or bfloat16) |
|
experts: |
|
- source_model: /Users/dawn/git/models/Silicon-Maid-7B |
|
positive_prompts: |
|
- "roleplay" |
|
- source_model: /Users/dawn/git/models/Starling-LM-7B-beta |
|
positive_prompts: |
|
- "chat" |
|
|
|
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) |
|
|
|
| Metric |Value| |
|
|---------------------------------|----:| |
|
|Avg. |70.20| |
|
|AI2 Reasoning Challenge (25-Shot)|67.15| |
|
|HellaSwag (10-Shot) |85.00| |
|
|MMLU (5-Shot) |65.36| |
|
|TruthfulQA (0-shot) |57.98| |
|
|Winogrande (5-shot) |79.79| |
|
|GSM8k (5-shot) |65.88| |
