transformers
torch
gradio
auto-gptq 
optimum 
bitsandbytes
peft