Hugging Face's logo

Spaces:
mikeee
/
llama2-7b-chat-ggml
Runtime error

App Files Community
ffreemt commited on
Commit
df9248e
•
1 Parent(s): e1bd529

Fix concurrency_count to avoid OOM

Browse files
Files changed (1) hide show
  1. app.py +2 -0
app.py CHANGED
@@ -474,4 +474,6 @@ with gr.Blocks(
474
  # CPU UPGRADE cpu_count=8 32G, model 7G
475
 
476
  concurrency_count = max(psutil.virtual_memory().total / 10**9 // file_size - 1, 1)
 
 
477
  block.queue(concurrency_count=concurrency_count, max_size=5).launch(debug=True)
 
474
  # CPU UPGRADE cpu_count=8 32G, model 7G
475
 
476
  concurrency_count = max(psutil.virtual_memory().total / 10**9 // file_size - 1, 1)
477
+ logger.info(f"{concurrency_count=}")
478
+
479
  block.queue(concurrency_count=concurrency_count, max_size=5).launch(debug=True)