| license: apache-2.0 | |
| library_name: peft | |
| tags: | |
| - generated_from_trainer | |
| base_model: GeneZC/MiniChat-1.5-3B | |
| model-index: | |
| - name: smol-3b | |
| results: [] | |
| <!-- This model card has been generated automatically according to the information the Trainer had access to. You | |
| should probably proofread and complete it, then remove this comment. --> | |
| # smol-3b | |
| See how open weights instead of open source feel like! | |
| # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) | |
| Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_rishiraj__smol-3b) | |
| | Metric |Value| | |
| |---------------------------------|----:| | |
| |Avg. |50.27| | |
| |AI2 Reasoning Challenge (25-Shot)|46.33| | |
| |HellaSwag (10-Shot) |68.23| | |
| |MMLU (5-Shot) |46.33| | |
| |TruthfulQA (0-shot) |50.73| | |
| |Winogrande (5-shot) |65.35| | |
| |GSM8k (5-shot) |24.64| | |