Hugging Face's logo

mudler
/
LocalAI-Llama3-8b-Function-Call-v0.2-GGUF

Model card Files Community
1
LocalAI-Llama3-8b-Function-Call-v0.2-GGUF / README.md
mudler's picture
mudler
Create README.md
1e5b868 verified
preview code
|
raw
history blame
629 Bytes

LocalAI-Llama3-8b-Function-Call-v0.2

local-ai-banner.png

LocalAIFCALL

This model is a fine-tune on a custom dataset + glave to work specifically and leverage all the LocalAI features of constrained grammar.

Specifically, the model once enters in tools mode will always reply with JSON.

To run on LocalAI:

local-ai run huggingface://mudler//LocalAI-Llama3-8b-Function-Call-v0.2-GGUF/localai.yaml