Update README.md

README.md

@@ -34,23 +34,46 @@ The lora merged model is [here](https://huggingface.co/uukuguy/Mistral-7B-OpenOr
 
 The source code is [here](https://github.com/uukuguy/multi_loras)
 
+## Mistral-7B-OpenOrca
+
+- Extract lora model [Mistral-7B-OpenOrca-lora](https://huggingface.co/uukuguy/Mistral-7B-OpenOrca-lora) from [Mistral-7B-OpenOrca](https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca);
+
+- Merge the base model [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) with lora model to [Mistral-7B-OpenOrca-lora-merged](https://huggingface.co/uukuguy/Mistral-7B-OpenOrca-lora-merged)
+
+- LLM Evaluation ...
+
+### Local Test
+
+| | ARC_acc_norm (25-shot) | HellaSwag_acc_norm (10-shot) | MMLU_acc (5-shot) | TruthfulQA_mc2 (0-shot) | GSM8K_acc (8-shot) | Open LLM Score |
+| ------ | ------ | ------ | ------ | ------ | ------ | ------ |
+| Mistral-7B-OpenOrca | **71** | 83 | 61.42 | 45 | 40 | 65.11 |
+| **r=64** | 67 | 84 | **64.26** | **47.32** | **41** | **65.65** |
+| *r=16* | *65* | *83* | *62.84* | *46.95* | *38* | *64.45* |
+
+### Open LLM Leaderboard
+| | ARC_acc_norm (25-shot) | HellaSwag_acc_norm (10-shot) | MMLU_acc (5-shot) | TruthfulQA_mc2 (0-shot) | Open LLM Score |
+| ------ | ------ | ------ | ------ | ------ | ------ |
+| Mistral-7B-SlimOrca | 62.54 | 83.86 | **62.77** | **54.23** |  **65.85** |
+| Mistral-7B-OpenOrca | **64.08** | **83.99** | 62.24 | 53.05 |  65.84 |
+
+
 ## lm-evaluation-harness
 
 [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
 
-| Metric | Mistral-7B-OpenOrca | Mistral-7B-OpenOrca-lora|
-| --- | --- |--- |
-| ARC | 64.08 | |
-| HellaSwag | 83.99 | |
-| MMLU | 62.24 | |
-| TruthfulQA | 53.05 | |
-| Average | 65.84 | |
+| Metric | Mistral-7B-OpenOrca | Mistral-7B-OpenOrca-lora| Mistral-7B-OpenOrca-lora-merged |
+| --- | --- |--- | --- |
+| ARC | 64.08 | | |
+| HellaSwag | 83.99 | | |
+| MMLU | 62.24 | | |
+| TruthfulQA | 53.05 | | |
+| Average | 65.84 | | |
 
 ## HumanEval
 
-| Metric | Mistral-7B-OpenOrca | Mistral-7B-OpenOrca-lora|
-| --- | --- | --- |
-| humaneval-python | 35.976 | |
+| Metric | Mistral-7B-OpenOrca | Mistral-7B-OpenOrca-lora|Mistral-7B-OpenOrca-lora-merged |
+| --- | --- | --- | --- |
+| humaneval-python | 35.976 | | |
 
 
 ## Training procedure