Updates in EXAONE-3.5
Key Changes
- RoPE Scaling Parameter: Added to support longer
context_length. - Memory Optimization: For the 2.4B model,
tie_word_embeddingsis set toTruefor improved memory efficiency.
⚠️ Using the original Llamafy script as-is may lead to performance degradation.
To address this, I have updated the script and uploaded the Llamafied version of the model.
Special Thanks
@maywell
For updating the code and uploading the model.LG AI Research
For releasing the original model.
Check out the original release here.
- Downloads last month
- 76
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.