|
--- |
|
license: apache-2.0 |
|
datasets: |
|
- iamtarun/python_code_instructions_18k_alpaca |
|
language: |
|
- en |
|
pipeline_tag: text-generation |
|
tags: |
|
- code |
|
--- |
|
|
|
# rahuldshetty/tinyllama-python-gguf |
|
|
|
Quantized GGUF model files for [tinyllama-python](https://huggingface.co/rahuldshetty/tinyllama-python). |
|
|
|
- Base model: [unsloth/tinyllama-bnb-4bit](https://huggingface.co/unsloth/tinyllama-bnb-4bit) |
|
- Dataset: [iamtarun/python_code_instructions_18k_alpaca](https://huggingface.co/datasets/iamtarun/python_code_instructions_18k_alpaca) |
|
- Training Script: [unslothai: Alpaca + TinyLlama + RoPE Scaling full example.ipynb](https://colab.research.google.com/drive/1AZghoNBQaMDgWJpi4RbffGM1h6raLUj9?usp=sharing) |
|
|
|
| Name | Quant method | Size | |
|
| ---- | ---- | ---- | |
|
| [tinyllama-python-unsloth.Q2_K.gguf](https://huggingface.co/rahuldshetty/tinyllama-python-gguf/resolve/main/tinyllama-python-unsloth.Q2_K.gguf) | fp16 | 432 MB | |
|
|
|
|
|
## Prompt Format |
|
|
|
``` |
|
### Instruction: |
|
{instruction} |
|
|
|
### Response: |
|
``` |
|
|
|
## Example |
|
|
|
``` |
|
### Instruction: |
|
Write a function to find cube of a number. |
|
|
|
### Response: |
|
``` |
|
|
|
|
