Chocolatine🍫🥖
Collection
DPO fine-tuned models Family, high performance
•
12 items
•
Updated
•
6
Quantized q4_k_m GGUF version of the original model Chocolatine-3B-Instruct-DPO-Revised
can be used on a CPU device, compatible llama.cpp
now supported architecture by LM Studio.
Also ready for Raspberry Pi 5 8Gb.
Usage:
ollama run jpacifico/chocolatine-3b
Ollama Modelfile example :
FROM ./chocolatine-3b-instruct-dpo-revised-q4_k_m.gguf
TEMPLATE """{{ if .System }}<|system|>
{{ .System }}<|end|>
{{ end }}{{ if .Prompt }}<|user|>
{{ .Prompt }}<|end|>
{{ end }}<|assistant|>
{{ .Response }}<|end|>
"""
PARAMETER stop """{"stop": ["<|end|>","<|user|>","<|assistant|>"]}"""
SYSTEM """You are a friendly assistant called Chocolatine."""
The Chocolatine model is a quick demonstration that a base model can be easily fine-tuned to achieve compelling performance.
It does not have any moderation mechanism.