|
# creco-inference |
|
Unified inference code for SageMaker and Hugging Face endpoints |
|
|
|
## Deployment |
|
|
|
- Inference code (this) should be placed in the model folder respectively, |
|
|
|
### SageMaker |
|
|
|
``` |
|
model/ |
|
code/ |
|
(repo) <-- The repo inference code as direct child (no sub-folder) |
|
vae |
|
unet |
|
... |
|
``` |
|
|
|
- Refer `deployment.ipynb` for creating endpoint. |
|
|
|
### Hugging Face |
|
|
|
``` |
|
model/ |
|
(repo) <-- The repo inference code as direct child (no sub-folder) |
|
vae |
|
unet |
|
... |
|
``` |
|
|
|
- Refer [doc](https://huggingface.co/docs/inference-endpoints/guides/create_endpoint) to create endpoint. |
|
|