Uploaded model

  • Developed by: 922-CA
  • License: apache-2.0
  • Finetuned from model : unsloth/gemma-2-9b-bnb-4bit

This gemma2 model was trained 2x faster with Unsloth and Huggingface's TRL library.

GGUFs of Gemmonika-ddlc-9b-v1. (Primarily tested and run with Koboldcpp v1.68+).

Downloads last month
94
GGUF
Model size
9.24B params
Architecture
gemma2
Hardware compatibility
Log In to view the estimation

4-bit

5-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for 922-CA/gem-monika-ddlc-9b-v1-gguf

Base model

google/gemma-2-9b
Quantized
(142)
this model