File size: 1,523 Bytes
888d462 50b4134 888d462 3078d4a 888d462 3078d4a 888d462 50b4134 888d462 6042229 97aa094 6042229 c0a8364 50b4134 888d462 50b4134 888d462 6b01d32 888d462 50b4134 888d462 50b4134 888d462 50b4134 888d462 50b4134 888d462 50b4134 888d462 50b4134 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 |
---
library_name: transformers
tags:
- cybersecurity
- security
- cybersec
- base
- llama3
license: llama3
language:
- en
---
# Colibri_8b_v0.1
<!-- Provide a quick summary of what the model is/does. -->
<img src="https://huggingface.co/CyberNative-AI/Colibri_8b_v0.1/resolve/main/cybernative_ai_colibri_logo.jpeg" alt="CyberNative-AI/Colibri_8b_v0.1"/>
## Colibri: Conversational CyberSecurity Model
[**TRY** colibri via huggingface Spaces!](https://huggingface.co/spaces/CyberNative-AI/Colibri_8b_v0.1_chat)
GGUF Quant used in Spaces available here: <a href="https://huggingface.co/CyberNative-AI/Colibri_8b_v0.1_q5_gguf">CyberNative-AI/Colibri_8b_v0.1_q5_gguf</a>
Colibri_8b_v0.1 is a conversational model for cybersecurity fine-tuned from the awesome [dolphin-2.9-llama3-8b](https://huggingface.co/cognitivecomputations/dolphin-2.9-llama3-8b). (llama-3-8b -> cognitivecomputations/dolphin-2.9-llama3-8b -> CyberNative-AI/Colibri_8b_v0.1)
We derived our training dataset by creating Q/A pairs from a huge amount of cybersecurity related texts.
> v0.1 trained for 3 epochs using around 35k Q/A pairs FFT on all parameters using a single A100 80gb for 3 hours.
This model is using ChatML prompt template format.
example:
```
<|im_start|>system
You are Colibri, an advanced cybersecurity AI assistant developed by CyberNative AI.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
```
Provided by [CyberNative AI](https://cybernative.ai/)
*ANY ILLEGAL AND/OR UNETHICAL USE IS NOT PERMITTED!* |