Commit
·
bd34c99
1
Parent(s):
40f4716
Update README.md
Browse files
README.md
CHANGED
@@ -5,7 +5,9 @@ license: apache-2.0
|
|
5 |
---
|
6 |
|
7 |
**Paper**: [Adapting Language Models to Compress Contexts](https://arxiv.org/abs/2305.14788)
|
|
|
8 |
**Code**: https://github.com/princeton-nlp/AutoCompressors
|
|
|
9 |
**Models**:
|
10 |
- Llama-2-7b fine-tuned models: [AutoCompressor-Llama-2-7b-6k](https://huggingface.co/princeton-nlp/AutoCompressor-Llama-2-7b-6k/), [FullAttention-Llama-2-7b-6k](https://huggingface.co/princeton-nlp/FullAttention-Llama-2-7b-6k)
|
11 |
- OPT-2.7b fine-tuned models: [AutoCompressor-2.7b-6k](https://huggingface.co/princeton-nlp/AutoCompressor-2.7b-6k), [AutoCompressor-2.7b-30k](https://huggingface.co/princeton-nlp/AutoCompressor-2.7b-30k), [RMT-2.7b-8k](https://huggingface.co/princeton-nlp/RMT-2.7b-8k)
|
|
|
5 |
---
|
6 |
|
7 |
**Paper**: [Adapting Language Models to Compress Contexts](https://arxiv.org/abs/2305.14788)
|
8 |
+
|
9 |
**Code**: https://github.com/princeton-nlp/AutoCompressors
|
10 |
+
|
11 |
**Models**:
|
12 |
- Llama-2-7b fine-tuned models: [AutoCompressor-Llama-2-7b-6k](https://huggingface.co/princeton-nlp/AutoCompressor-Llama-2-7b-6k/), [FullAttention-Llama-2-7b-6k](https://huggingface.co/princeton-nlp/FullAttention-Llama-2-7b-6k)
|
13 |
- OPT-2.7b fine-tuned models: [AutoCompressor-2.7b-6k](https://huggingface.co/princeton-nlp/AutoCompressor-2.7b-6k), [AutoCompressor-2.7b-30k](https://huggingface.co/princeton-nlp/AutoCompressor-2.7b-30k), [RMT-2.7b-8k](https://huggingface.co/princeton-nlp/RMT-2.7b-8k)
|