Spaces:

wiklif
/

my-api

Sleeping

wiklif commited on Jul 24, 2024

Commit

53cab83

1 Parent(s): f28f9e0

naprawa literówki

Files changed (1) hide show

app.py CHANGED Viewed

@@ -26,7 +26,7 @@ def load_model():
                 token=os.environ.get("MY_API_LLAMA_3_1"),
                 torch_dtype=torch.bfloat16,
                 device_map="auto",
-                low_cpu_mem_usage=True
                 load_in_8bit=True
             )
             logger.info("Model loaded successfully")

                 token=os.environ.get("MY_API_LLAMA_3_1"),
                 torch_dtype=torch.bfloat16,
                 device_map="auto",
+                low_cpu_mem_usage=True,
                 load_in_8bit=True
             )
             logger.info("Model loaded successfully")