Spaces:

YenJung
/

Medical_GPT

Runtime error

YenJung commited on Nov 3, 2023

Commit

d1bad0f

•

1 Parent(s): cea37bd

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -1,7 +1,7 @@
 import gradio as gr
 from model import ModelServe
-model = ModelServe(load_8bit=False)
 demo = gr.Interface(
     fn=model.generate,
     inputs=[

 import gradio as gr
 from model import ModelServe
+model = ModelServe(load_8bit=True)
 demo = gr.Interface(
     fn=model.generate,
     inputs=[