---
base_model:
- CarrotAI/EXAONE-3.0-7.8B-Instruct-Llamafied-8k
pipeline_tag: text-generation
language:
- en
- ko
---
LG AI EXAONE3 -> llamafy + 8K Context length -> 4bit awq quantized model 

tested in vllm, just for use

'''
vllm serve lee5j/EXAONE3-IT8k-llamafy-awq --enforce-eager --gpu-memory-utilization 0.99 
'''


Lincense : https://huggingface.co/LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct/blob/main/LICENSE 

origin model : LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct