Spaces:

sergiopaniego
/

LongerThinkingLLM

Sleeping

sergiopaniego commited on 26 days ago

Commit

c9a647e

1 Parent(s): 1ac11cc

test

Files changed (1) hide show

app.py CHANGED Viewed

@@ -26,7 +26,6 @@ llm = LLM(
     gpu_memory_utilization=0.5,  # Utilize 50% of GPU memory
     enable_prefix_caching=True,  # Optimize repeated prefix computations
     seed=42,  # Set seed for reproducibility
-    config=device_config
 )

     gpu_memory_utilization=0.5,  # Utilize 50% of GPU memory
     enable_prefix_caching=True,  # Optimize repeated prefix computations
     seed=42,  # Set seed for reproducibility
 )