ruGPT-3.5-13B-GGUF

• Model creator: ai-forever
• Original model: ruGPT-3.5-13B

Description

This repository contains quantized GGUF format model files for ruGPT-3.5-13B.

Prompt template:

{prompt}

Example llama.cpp command

./main -m ruGPT-3.5-13B-Q4_K_M.gguf -c 2048 -n -1 -p 'Стих про программиста может быть таким:'

For other parameters and how to use them, please refer to the llama.cpp documentation