squeeze-ai-lab
commited on
Commit
•
d2ee9b7
1
Parent(s):
f965f09
Update README.md
Browse files
README.md
CHANGED
@@ -59,6 +59,10 @@ TinyAgent models are fine-tuned from base models. Below is a table of each TinyA
|
|
59 |
|
60 |
Using the synthetic data generation process described above, we use parameter-efficient fine-tuning with LoRA to fine-tune the base models for 3 epochs. Please check out our blog post for more details on our fine-tuning procedure.
|
61 |
|
|
|
|
|
|
|
|
|
62 |
## Links
|
63 |
**Blog Post**:
|
64 |
|
|
|
59 |
|
60 |
Using the synthetic data generation process described above, we use parameter-efficient fine-tuning with LoRA to fine-tune the base models for 3 epochs. Please check out our blog post for more details on our fine-tuning procedure.
|
61 |
|
62 |
+
### 🛠️ ToolRAG
|
63 |
+
|
64 |
+
When faced with challenging tasks, SLM agents require appropriate tools and in-context examples to guide them. If the model sees irrelevant examples, it can hallucinate. Likewise, if the model sees the descriptions of the tools that it doesn’t need, it usually gets confused, and these tools take up unnecessary prompt space. To tackle this, TinyAgent uses ToolRAG to retrieve the best tools and examples suited for a given query. This process has minimal latency and increases the accuracy of TinyAgent substantially. Please take a look at our blog post and our [ToolRAG model](https://huggingface.co/squeeze-ai-lab/TinyAgent-ToolRAG) for more details.
|
65 |
+
|
66 |
## Links
|
67 |
**Blog Post**:
|
68 |
|