Matter 0.2
Collection
DPO & Fine-tuned models with function calling on the Matter-0.2 dataset. 8x22B, 32B, 7B sizes
β’
6 items
β’
Updated
β’
1
DPO version of Matter 7B fine-tuned on the Matter dataset, which is curated from over 35 datsets analyzing >6B tokens
Prompt format: This model uses ChatML prompt format.
<|im_start|>system
You are a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
Model also supports function calling. Additional tokens for function calling
Model function call tokens
Function call response tokens
Example
<|im_start|>system
You are a helpful assistant with access to the following functions. Use them if required -
{ "name": "get_news_headlines",
"description": "Get the latest news headlines",
"parameters":
{ "type": "object",
"properties":
{ "country":
{ "type": "string",
"description": "The country for which to fetch news"
}
},
"required": [ "country" ]
}
}
<|im_end|>
<|im_start|>user
Can you tell me the latest news headlines for the United States?<|im_end|>
<|im_start|>assistant
<|begin_func|>{"name": "get_news_headlines", "arguments": '{"country": "United States"}'}<|end_func|><|im_end|>
<|im_start|>user
<|begin_func_response|>{
"headlines":
[
"Biden announces new vaccine mandates",
"Hurricane Ida devastates Louisiana",
"Apple unveils new iPhone",
"NASA's Perseverance rover collects first Mars rock sample"
]
}<|end_func_response|>
<|im_end|>
<|im_start|>assistant
Here are the latest news headlines for the United States:
1. Biden announces new vaccine mandates
2. Hurricane Ida devastates Louisiana
3. Apple unveils new iPhone
4. NASA's Perseverance rover collects first Mars rock sample
<|im_end|>
Detailed results can be found here
Metric | Value |
---|---|
Avg. | 8.81 |
IFEval (0-Shot) | 33.03 |
BBH (3-Shot) | 10.06 |
MATH Lvl 5 (4-Shot) | 0.83 |
GPQA (0-shot) | 1.23 |
MuSR (0-shot) | 5.87 |
MMLU-PRO (5-shot) | 1.82 |