aikitoria PRO
aikitoria
AI & ML interests
Local LLM & image gen
Recent Activity
new activity
10 days ago
unsloth/DeepSeek-R1-GGUF:Running the model with vLLM does not actually work
updated
a model
about 1 month ago
aikitoria/Llama-3.3-70B-Instruct_sm89_tp8_fp8_cache8
updated
a model
about 1 month ago
aikitoria/Mistral-Large-Instruct-2411_sm89_tp4_auto_5bpw
Organizations
aikitoria's activity
Running the model with vLLM does not actually work
8
#12 opened 11 days ago
by
aikitoria
Thank you for posting memory usage
1
#1 opened about 1 year ago
by
tensiondriven
More quants
1
#2 opened about 1 year ago
by
aikitoria