Hugging Face's logo

Spaces:
microsoft
/
LLMLingua
Running

App Files Community
1
iofu728 commited on
Commit
0b319ad
•
1 Parent(s): b7f85ba

Feature(LLMLingua): build the LLMLingua space demo

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -1,7 +1,7 @@
1
  import gradio as gr
2
  from llmlingua import PromptCompressor
3
 
4
- llm_lingua = PromptCompressor(device_map="cpu")
5
 
6
  INTRO = """
7
  # LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models
 
1
  import gradio as gr
2
  from llmlingua import PromptCompressor
3
 
4
+ llm_lingua = PromptCompressor("ayoubkirouane/StableLM-3B", device_map="cpu")
5
 
6
  INTRO = """
7
  # LLMLingua: Compressing Prompts for Accelerated Inference of Large Language Models