Hugging Face's logo

Chinnu1103
/
FineLlama-3.2-3B-GGUF

Transformers
GGUF
English
llama
text-generation-inference
unsloth
Inference Endpoints
conversational
Model card Files Community
Chinnu1103 commited on
Commit
d294513
·
verified ·
1 Parent(s): 0439890

(Trained with Unsloth)

Browse files
Files changed (1) hide show
  1. Modelfile +1 -1
Modelfile CHANGED
@@ -1,5 +1,5 @@
1
 
2
- FROM /content/Chinnu1103/FineLlama-3.2-3B-GGUF/unsloth.F16.gguf
3
  TEMPLATE """{{ if .System }}<|im_start|>system
4
  {{ .System }}<|im_end|>
5
  {{ end }}{{ if .Prompt }}<|im_start|>user
 
1
 
2
+ FROM /content/Chinnu1103/FineLlama-3.2-3B-GGUF/unsloth.Q8_0.gguf
3
  TEMPLATE """{{ if .System }}<|im_start|>system
4
  {{ .System }}<|im_end|>
5
  {{ end }}{{ if .Prompt }}<|im_start|>user