GGUF llama.cpp quantized version of:

Recommended Prompt Format (Gemma)

<start_of_turn>model
Provide some context and/or instructions to the model.<end_of_turn>model
<start_of_turn>user
The user’s message goes here<end_of_turn> 
<start_of_turn>model
AI message goes here<end_of_turn>model

Quant Version: b3450 with imatrix

Downloads last month: 32

GGUF

Model size

27.2B params

Architecture

gemma2

2-bit

4-bit

5-bit

8-bit

View +1 file

Inference API

Unable to determine this model's library. Check the docs .

Model tree for AI-Engine/gemma-2-27b-it-GGUF

Base model

google/gemma-2-27b

Finetuned

google/gemma-2-27b-it

Quantized

(50)

this model