Will Reynolds

willowill5's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in mistralai/Mixtral-8x7B-Instruct-v0.1 11 months ago

OOM with vllm

#48 opened 11 months ago by willowill5

New activity in TheBloke/zephyr-7B-beta-AWQ 11 months ago

vLLM out of memory

2

#2 opened 12 months ago by cfrancois7

New activity in TheBloke/zephyr-7B-alpha-AWQ 12 months ago

OOM on RTX 3090 with vLLM

#1 opened 12 months ago by willowill5

New activity in TheBloke/Falcon-180B-Chat-AWQ about 1 year ago

Quantization not recognized, even when building VLLM from source

2

#1 opened about 1 year ago by willowill5

New activity in TheBloke/Falcon-180B-Chat-GPTQ about 1 year ago

very slow inference speed on 2x A100 80GB with 4-bit (main branch)

#6 opened about 1 year ago by willowill5