--- base_model: google/gemma-2-27b-it inference: false license: gemma library_name: transformers pipeline_tag: text-generation model_creator: Google model_name: gemma-2-27b-it quantized_by: Second State Inc. tags: - conversational --- ![](https://github.com/GaiaNet-AI/.github/assets/45785633/d6976adc-f97d-4f86-a648-0f2f5c8e7eee) # Gemma-2-27b-it-GGUF ## Original Model [google/gemma-2-27b-it](https://huggingface.co/google/gemma-2-27b-it) ## Run with Gaianet **Prompt template:** prompt template: `gemma-instruct` **Context size:** chat_ctx_size: `8192` **Run with GaiaNet:** - Quick start: https://docs.gaianet.ai/node-guide/quick-start - Customize your node: https://docs.gaianet.ai/node-guide/customize *Quantized with llama.cpp pr-8156*