Model does not load evenly on all available GPUs device_map= auto leading to OOM
1
#34 opened 2 days ago
by
sugunav14
Running into a tensor size error
2
#33 opened 2 days ago
by
AaronVogler
Can't run on a single H100
4
#27 opened 3 days ago
by
jvieirasobrinho
Cannot generate with BS > 1
1
#25 opened 5 days ago
by
chenjiel
Unable to run with vllm
#24 opened 5 days ago
by
rdodev

Confirm prohibited EU hosting
2
#20 opened 5 days ago
by
andrej-schreiner
Access rejected
6
#18 opened 6 days ago
by
sruthikesh
[request for feedback] Faster downloads with Xet
#17 opened 6 days ago
by
clem

Are these the pre-trained or mid-trained models?
#16 opened 6 days ago
by
deltanym

License
1
#14 opened 6 days ago
by
mrfakename
