Audio-Text-to-Text
Safetensors
English
llama
sound language model
torchtune
jan-hq commited on
Commit
02db5f3
1 Parent(s): 61e2d03

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -116,8 +116,9 @@ pipe = setup_pipeline(llm_path, use_8bit=True)
116
  | Model | MMLU Score |
117
  | --- | --- |
118
  | llama3.5-instruct-8b | 69.40 |
 
119
  | ichigo-llama3.1-s-v0.3: phase 3 | 63.79 |
120
- | ichigo-llama3.1-s-v0.3: phase 2 | **63.08** |
121
  | ichigo-llama3.1-s-base-v0.3 | 42.11 |
122
  | llama3.5-instruct-v0.2 | 50.27 |
123
 
@@ -126,7 +127,8 @@ pipe = setup_pipeline(llm_path, use_8bit=True)
126
  | Model Bench | [Open-hermes Instruction Audio](https://huggingface.co/datasets/AudioLLMs/openhermes_instruction_test) (GPT-4-O judge 0:5) | [Alpaca Instruction Audio](https://huggingface.co/datasets/AudioLLMs/alpaca_audio_test) (GPT-4-O judge 0:5) |
127
  | --- | --- | --- |
128
  | [Llama3.1-s-v2](https://huggingface.co/homebrewltd/llama3-s-instruct-v0.2) | 3.45 | 3.53 |
129
- | [Ichigo-llama3.1-s v0.3-phase2 -cp7000](https://huggingface.co/homebrewltd/Ichigo-llama3.1-s-instruct-v0.3-phase-2) | **3.42** | **3.62** |
 
130
  | [Ichigo-llama3.1-s v0.3-phase2-cplast](https://huggingface.co/jan-hq/llama3-s-instruct-v0.3-checkpoint-last) | 3.31 | 3.6 |
131
  | [Ichigo-llama3.1-s v0.3-phase3](https://huggingface.co/homebrewltd/Ichigo-llama3.1-s-instruct-v0.3-phase-3) | 3.64 | 3.68 |
132
  | [Qwen2-audio-7B](https://huggingface.co/Qwen/Qwen2-Audio-7B) | 2.63 | 2.24 |
 
116
  | Model | MMLU Score |
117
  | --- | --- |
118
  | llama3.5-instruct-8b | 69.40 |
119
+ | ichigo-llama3.1-s-v0.4| **64.63** |
120
  | ichigo-llama3.1-s-v0.3: phase 3 | 63.79 |
121
+ | ichigo-llama3.1-s-v0.3: phase 2 | 63.08 |
122
  | ichigo-llama3.1-s-base-v0.3 | 42.11 |
123
  | llama3.5-instruct-v0.2 | 50.27 |
124
 
 
127
  | Model Bench | [Open-hermes Instruction Audio](https://huggingface.co/datasets/AudioLLMs/openhermes_instruction_test) (GPT-4-O judge 0:5) | [Alpaca Instruction Audio](https://huggingface.co/datasets/AudioLLMs/alpaca_audio_test) (GPT-4-O judge 0:5) |
128
  | --- | --- | --- |
129
  | [Llama3.1-s-v2](https://huggingface.co/homebrewltd/llama3-s-instruct-v0.2) | 3.45 | 3.53 |
130
+ | [Ichigo-llama3.1-s v0.4](homebrewltd/Ichigo-llama3.1-s-instruct-v0.4) | **3.5** | **3.52** |
131
+ | [Ichigo-llama3.1-s v0.3-phase2 -cp7000](https://huggingface.co/homebrewltd/Ichigo-llama3.1-s-instruct-v0.3-phase-2) | 3.42 | 3.62 |
132
  | [Ichigo-llama3.1-s v0.3-phase2-cplast](https://huggingface.co/jan-hq/llama3-s-instruct-v0.3-checkpoint-last) | 3.31 | 3.6 |
133
  | [Ichigo-llama3.1-s v0.3-phase3](https://huggingface.co/homebrewltd/Ichigo-llama3.1-s-instruct-v0.3-phase-3) | 3.64 | 3.68 |
134
  | [Qwen2-audio-7B](https://huggingface.co/Qwen/Qwen2-Audio-7B) | 2.63 | 2.24 |