datalama's picture
Create README.md
7d88d95 verified
metadata
license: other
license_name: exaone
license_link: LICENSE
language:
  - en
  - ko
tags:
  - lg-ai
  - exaone
  - exaone-3.5
pipeline_tag: text-generation
library_name: transformers

Updates in EXAONE-3.5

Key Changes

  • RoPE Scaling Parameter: Added to support longer context_length.
  • Memory Optimization: For the 2.4B model, tie_word_embeddings is set to True for improved memory efficiency.

⚠️ Using the original Llamafy script as-is may lead to performance degradation.

To address this, I have updated the script and uploaded the Llamafied version of the model.

Special Thanks