Spaces:
Running
Running
Feature(LLMLingua): add LLMLingua paper link
Browse files
app.py
CHANGED
@@ -4,7 +4,7 @@ from llmlingua import PromptCompressor
|
|
4 |
llm_lingua = PromptCompressor("lgaalves/gpt2-dolly", device_map="cpu")
|
5 |
|
6 |
INTRO = """
|
7 |
-
# LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models (EMNLP 2023) [paper]()
|
8 |
_Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang and Lili Qiu_
|
9 |
|
10 |
This is an early demo of the prompt compression method LLMLingua.
|
|
|
4 |
llm_lingua = PromptCompressor("lgaalves/gpt2-dolly", device_map="cpu")
|
5 |
|
6 |
INTRO = """
|
7 |
+
# LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models (EMNLP 2023) [[paper](https://arxiv.org/abs/2310.05736)]
|
8 |
_Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang and Lili Qiu_
|
9 |
|
10 |
This is an early demo of the prompt compression method LLMLingua.
|