File size: 779 Bytes
fe7b657 33b4d02 fe7b657 add6174 fe7b657 9525ef7 fe7b657 add6174 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 |
---
base_model: 01-ai/Yi-1.5-9B-Chat-16K
inference: false
model_creator: 01-ai
model_name: Yi-1.5-9B-Chat-16
model_type: yi
pipeline_tag: text-generation
quantized_by: Second State Inc.
license: apache-2.0
---
# Yi-1.5-9B-Chat-16K-GGUF
## Original Model
[01-ai/Yi-1.5-9B-Chat-16K](https://huggingface.co/01-ai/Yi-1.5-9B-Chat-16K)
## Run with Gaianet
**Prompt template**
prompt template: `chatml`
**Reverse prompt**
reverse prompt: `<|im_end|>`
**Context size**
chat_ctx_size: `16384`
**Run with GaiaNet**
- Quick start: https://docs.gaianet.ai/node-guide/quick-start
- Customize your node: https://docs.gaianet.ai/node-guide/customize
*Quantized with llama.cpp b3135*
|