fastapi
uvicorn
huggingface_hub
llama-cpp-python
pydantic
transformers
torch==2.0.1+cu117
torchvision==0.15.2+cu117
torchaudio==2.0.2+cu117
-f https://download.pytorch.org/whl/torch_stable.html