fastapi
uvicorn
transformers
torch 
pydantic
optimum[openvino]
neural-compressor
accelerate