Will Reynolds
willowill5
·
AI & ML interests
LLMs, Talking Head Animation
Recent Activity
liked
a model
12 days ago
gaunernst/gemma-3-27b-it-int4-awq
liked
a model
25 days ago
NousResearch/DeepHermes-3-Llama-3-8B-Preview
liked
a model
8 months ago
XLabs-AI/flux-controlnet-collections
Organizations
None yet
willowill5's activity
OOM with vllm
#48 opened over 1 year ago
by
willowill5

vLLM out of memory
2
#2 opened over 1 year ago
by
cfrancois7

OOM on RTX 3090 with vLLM
#1 opened over 1 year ago
by
willowill5

Quantization not recognized, even when building VLLM from source
2
#1 opened over 1 year ago
by
willowill5

very slow inference speed on 2x A100 80GB with 4-bit (main branch)
#6 opened over 1 year ago
by
willowill5
