README.md

---
library_name: transformers
license: llama3.2
language:
- ru
- en
pipeline_tag: text-generation
---

# Cotype Nano GGUF🤖

Llama-3-Cotype-Nano-GGUF– это легковесный ИИ, который может запускаться даже на мобильных девайсах



Llama-3-Cotype-Nano-GGUF is a lightweight AI that can run even on mobile devices

### Inference

```python
from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="MTSAIR/Cotype-Nano-GGUF",
	filename="cotype_nano_8bit.gguf",
)

llm.create_chat_completion(
	messages = [
		{
			"role": "user",
			"content": "What is the capital of France?"
		}
	]
)
```