Create README.md

README.md

@@ -0,0 +1,36 @@
+---
+library_name: transformers
+license: llama3.2
+language:
+- ru
+- en
+pipeline_tag: text-generation
+---
+
+# Cotype Nano GGUF🤖
+
+Llama-3-Cotype-Nano-GGUF– это легковесный ИИ, который может запускаться даже на мобильных девайсах
+
+
+
+Llama-3-Cotype-Nano-GGUF is a lightweight AI that can run even on mobile devices
+
+### Inference
+
+```python
+from llama_cpp import Llama
+
+llm = Llama.from_pretrained(
+	repo_id="MTSAIR/Cotype-Nano-GGUF",
+	filename="cotype_nano_8bit.gguf",
+)
+
+llm.create_chat_completion(
+	messages = [
+		{
+			"role": "user",
+			"content": "What is the capital of France?"
+		}
+	]
+)
+```