munish0838
commited on
Upload README.md with huggingface_hub
Browse files
README.md
ADDED
@@ -0,0 +1,66 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
|
2 |
+
---
|
3 |
+
|
4 |
+
license: creativeml-openrail-m
|
5 |
+
datasets:
|
6 |
+
- mlabonne/lmsys-arena-human-preference-55k-sharegpt
|
7 |
+
language:
|
8 |
+
- en
|
9 |
+
base_model:
|
10 |
+
- meta-llama/Llama-3.2-3B-Instruct
|
11 |
+
pipeline_tag: text-generation
|
12 |
+
library_name: transformers
|
13 |
+
tags:
|
14 |
+
- Llama
|
15 |
+
- Llama-Cpp
|
16 |
+
- Llama3.2
|
17 |
+
- Instruct
|
18 |
+
- 3B
|
19 |
+
- bin
|
20 |
+
- Sentient
|
21 |
+
|
22 |
+
---
|
23 |
+
|
24 |
+
[![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)
|
25 |
+
|
26 |
+
|
27 |
+
# QuantFactory/Llama-Sentient-3.2-3B-Instruct-GGUF
|
28 |
+
This is quantized version of [prithivMLmods/Llama-Sentient-3.2-3B-Instruct](https://huggingface.co/prithivMLmods/Llama-Sentient-3.2-3B-Instruct) created using llama.cpp
|
29 |
+
|
30 |
+
# Original Model Card
|
31 |
+
|
32 |
+
## Llama-Sentient-3.2-3B-Instruct Modelfile
|
33 |
+
|
34 |
+
| File Name | Size | Description | Upload Status |
|
35 |
+
|-----------------------------------------|--------------|-----------------------------------------|----------------|
|
36 |
+
| `.gitattributes` | 1.57 kB | Git attributes configuration file | Uploaded |
|
37 |
+
| `README.md` | 42 Bytes | Initial commit README | Uploaded |
|
38 |
+
| `config.json` | 1.04 kB | Configuration file | Uploaded |
|
39 |
+
| `generation_config.json` | 248 Bytes | Generation configuration file | Uploaded |
|
40 |
+
| `pytorch_model-00001-of-00002.bin` | 4.97 GB | PyTorch model file (part 1) | Uploaded (LFS) |
|
41 |
+
| `pytorch_model-00002-of-00002.bin` | 1.46 GB | PyTorch model file (part 2) | Uploaded (LFS) |
|
42 |
+
| `pytorch_model.bin.index.json` | 21.2 kB | Model index file | Uploaded |
|
43 |
+
| `special_tokens_map.json` | 477 Bytes | Special tokens mapping | Uploaded |
|
44 |
+
| `tokenizer.json` | 17.2 MB | Tokenizer JSON file | Uploaded (LFS) |
|
45 |
+
| `tokenizer_config.json` | 57.4 kB | Tokenizer configuration file | Uploaded |
|
46 |
+
|
47 |
+
| Model Type | Size | Context Length | Link |
|
48 |
+
|------------|------|----------------|------|
|
49 |
+
| GGUF | 3B | - | [🤗 Llama-Sentient-3.2-3B-Instruct-GGUF](https://huggingface.co/prithivMLmods/Llama-Sentient-3.2-3B-Instruct-GGUF) |
|
50 |
+
|
51 |
+
The **Llama-Sentient-3.2-3B-Instruct** model is a fine-tuned version of the **Llama-3.2-3B-Instruct** model, optimized for **text generation** tasks, particularly where instruction-following abilities are critical. This model is trained on the **mlabonne/lmsys-arena-human-preference-55k-sharegpt** dataset, which enhances its performance in conversational and advisory contexts, making it suitable for a wide range of applications.
|
52 |
+
|
53 |
+
### Key Use Cases:
|
54 |
+
1. **Conversational AI**: Engage in intelligent dialogue, offering coherent responses and following instructions, useful for customer support and virtual assistants.
|
55 |
+
2. **Text Generation**: Generate high-quality, contextually appropriate content such as articles, summaries, explanations, and other forms of written communication based on user prompts.
|
56 |
+
3. **Instruction Following**: Follow specific instructions with accuracy, making it ideal for tasks that require structured guidance, such as technical troubleshooting or educational assistance.
|
57 |
+
|
58 |
+
The model uses a **PyTorch-based architecture** and includes a range of necessary files such as configuration files, tokenizer files, and model weight files for deployment.
|
59 |
+
|
60 |
+
### Intended Applications:
|
61 |
+
- **Chatbots** for virtual assistance, customer support, or as personal digital assistants.
|
62 |
+
- **Content Creation Tools**, aiding in the generation of written materials, blog posts, or automated responses based on user inputs.
|
63 |
+
- **Educational and Training Systems**, providing explanations and guided learning experiences in various domains.
|
64 |
+
- **Human-AI Interaction** platforms, where the model can follow user instructions to provide personalized assistance or perform specific tasks.
|
65 |
+
|
66 |
+
With its strong foundation in instruction-following and conversational contexts, the **Llama-Sentient-3.2-3B-Instruct** model offers versatile applications for both general and specialized domains.
|