transformers
torch
gradio
accelerate>=0.26.0
peft
bitsandbytes