Base Model:

We made a LLM model with meta-llama/Meta-Llama-3-8B

Model Description

We use QDoRA(256, 64) and lr=1e-5, NEFTune=3

Train Detail

Our changed private data used, and 5 epoch train

Others

We are making LLM model for Kolon !

Downloads last month
1,694
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for KBNIT/Llama-3-8B-kolon-ITD-5-v1.0

Quantizations
3 models