README.md

# LocalAI-Llama3-8b-Function-Call-v0.2

![local-ai-banner.png](https://cdn-uploads.huggingface.co/production/uploads/647374aa7ff32a81ac6d35d4/bXvNcxQqQ-wNAnISmx3PS.png)

![LocalAIFCALL](https://cdn-uploads.huggingface.co/production/uploads/647374aa7ff32a81ac6d35d4/us5JKi9z046p8K-cn_M0w.webp)

This model is a fine-tune on a custom dataset + glave to work specifically and leverage all the LocalAI features of constrained grammar.

Specifically, the model once enters in tools mode will always reply with JSON.

To run on LocalAI:

```
local-ai run huggingface://mudler//LocalAI-Llama3-8b-Function-Call-v0.2-GGUF/localai.yaml
```