Spaces:

anand004
/

Multimodal-PDF-RAG

Runtime error

anand004 commited on Jun 24

Commit

f755dab

•

1 Parent(s): 0adab51

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -53,6 +53,7 @@ if torch.cuda.is_available():
         torch_dtype=torch.float16,
         low_cpu_mem_usage=True,
         load_in_4bit=True,
     )

         torch_dtype=torch.float16,
         low_cpu_mem_usage=True,
         load_in_4bit=True,
+        use_flash_attention_2=True
     )