Safetensors
qwen2
qypeng commited on
Commit
11cced2
1 Parent(s): 526e727

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -13
README.md CHANGED
@@ -8,24 +8,17 @@ base_model: Qwen/Qwen1.5-4B-Chat
8
 
9
  ## <font color=red>\[Updates!!!\]</font> Hammer 2.0 Series have been Published
10
 
11
- We're excited to introduce Hammer 2.0, the latest in our Hammer Large Language Models series designed to enhance AI function calling. Differing from existing models focusing on training data refinement, Hammer optimizes performance primarily through advanced training techniques. In this version, we release a number of models with sizes ranging from 0.5B to 7B:
12
- [0.5B](https://huggingface.co/MadeAgents/Hammer2.0-0.5b),
13
- [1.5B](https://huggingface.co/MadeAgents/Hammer2.0-1.5b),
14
- [4B](https://huggingface.co/MadeAgents/Hammer2.0-3b), and [7B](https://huggingface.co/MadeAgents/Hammer2.0-0.5b).
15
 
16
 
17
  ## Introduction
18
- **Hammer** is a series of cutting-edge Large Language Models (LLMs) crafted to boost the critical capability of AI agents: function calling. Differing from existing models focusing on training data refinement, Hammer optimizes performance primarily through advanced training techniques. Focusing on on-device applications, we release a number of models from 1.5B, 4B to 7B parameters.
19
 
20
  ## Model Details
21
- Hammer-4b is a finetuned model built upon [Qwen1.5-4B-Chat](https://huggingface.co/Qwen/Qwen1.5-4B-Chat). It's trained using the [APIGen Function Calling Datasets](https://huggingface.co/datasets/Salesforce/xlam-function-calling-60k) containing 60,000 samples, supplemented by [7,500 irrelevance detection data](https://huggingface.co/datasets/MadeAgents/XLAM-7.5k-Irrelevance) we generated. Employing innovative training techniques like function masking, function shuffling, and prompt optimization, Hammer-4b has achieved exceptional performances across numerous benchmarks including [Berkley Function Calling Leaderboard](https://gorilla.cs.berkeley.edu/leaderboard.html), [API-Bank](https://arxiv.org/abs/2304.08244), [Tool-Alpaca](https://arxiv.org/abs/2306.05301), [Nexus Raven](https://github.com/nexusflowai/NexusRaven-V2) and [Seal-Tools](https://arxiv.org/abs/2405.08355).
22
-
23
- ## Tuning Details
24
- A report with all the technical details leading to our models has been published at "[Hammer: Robust Function-Calling for On-Device Language Models via Function Masking](https://arxiv.org/abs/2410.04587)". All the code for data process, model tuning, and evaluation will also be open-sourced very soon.
25
-
26
 
27
  ## Evaluation
28
- First, we evaluate Hammer series on the Berkeley Function-Calling Leaderboard (BFCL):
29
 
30
  <div style="text-align: center;">
31
  <img src="figures/bfcl.PNG" alt="overview" width="1480" style="margin: auto;">
@@ -39,10 +32,10 @@ In addition, we evaluated our Hammer series (1.5b, 4b, 7b) on other academic ben
39
  <img src="figures/others.PNG" alt="overview" width="1000" style="margin: auto;">
40
  </div>
41
 
42
- Upon observing Hammer's performance across various benchmarks unrelated to the APIGen Function Calling Datasets, we find that Hammer demonstrates remarkably stable performance, which indicates the robustness of Hammers. In contrast, the baseline methods exhibit varying degrees of effectiveness across these other benchmarks.
43
 
44
  ## Requiements
45
- The code of Hammer-4b has been in the latest Hugging face transformers and we advise you to install `transformers>=4.37.0`.
46
 
47
  ## How to Use
48
  This is a simple example of how to use our model.
 
8
 
9
  ## <font color=red>\[Updates!!!\]</font> Hammer 2.0 Series have been Published
10
 
11
+ We're excited to release lightweight Hammer 2.0 models ([0.5B](https://huggingface.co/MadeAgents/Hammer2.0-0.5b) , [1.5B](https://huggingface.co/MadeAgents/Hammer2.0-1.5b) , [3B](https://huggingface.co/MadeAgents/Hammer2.0-3b) , and [7B](https://huggingface.co/MadeAgents/Hammer2.0-7b)) with strong function calling capability, which empower developers to build personalized, on-device agentic applications.
 
 
 
12
 
13
 
14
  ## Introduction
15
+ **Hammer** is a series of cutting-edge Large Language Models (LLMs) crafted to boost the critical capability of AI agents: function calling. Differing from existing models focusing on training data refinement, Hammer optimizes performance primarily through advanced training techniques. Focusing on on-device applications, we release a number of models from [1.5B](https://huggingface.co/MadeAgents/Hammer-1.5b), [4B](https://huggingface.co/MadeAgents/Hammer-4b) to [7B](https://huggingface.co/MadeAgents/Hammer-7b) parameters.
16
 
17
  ## Model Details
18
+ Hammer finetuned based on [Qwen 2.0 series](https://huggingface.co/collections/Qwen/qwen2-6659360b33528ced941e557f) using function masking techniques. It's trained using the [APIGen Function Calling Datasets](https://huggingface.co/datasets/Salesforce/xlam-function-calling-60k) containing 60,000 samples, supplemented by [xlam-irrelevance-7.5k](https://huggingface.co/datasets/MadeAgents/xlam-irrelevance-7.5k) we generated. Hammer has achieved exceptional performances across numerous function calling benchmarks. For more details, please refer to [Hammer: Robust Function-Calling for On-Device Language Models via Function Masking](https://arxiv.org/abs/2410.04587) and [Hammer GitHub repository](https://github.com/MadeAgents/Hammer).
 
 
 
 
19
 
20
  ## Evaluation
21
+ First, we evaluate Hammer series on the Berkeley Function-Calling Leaderboard (BFCL-v2):
22
 
23
  <div style="text-align: center;">
24
  <img src="figures/bfcl.PNG" alt="overview" width="1480" style="margin: auto;">
 
32
  <img src="figures/others.PNG" alt="overview" width="1000" style="margin: auto;">
33
  </div>
34
 
35
+ Hammer models showcase highly stable performance, suggesting the robustness of Hammer series. In contrast, the baseline approaches display varying levels of effectiveness.
36
 
37
  ## Requiements
38
+ The code of Hammer-7b has been in the latest Hugging face transformers and we advise you to install `transformers>=4.37.0`.
39
 
40
  ## How to Use
41
  This is a simple example of how to use our model.