File size: 584 Bytes
19b3da3
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
# creco-inference
Unified inference code for SageMaker and Hugging Face endpoints

## Deployment

- Inference code (this) should be placed in the model folder respectively,

### SageMaker

```
model/
  code/
    (repo)  <-- The repo inference code as direct child (no sub-folder)
  vae
  unet
  ...
```

- Refer `deployment.ipynb` for creating endpoint.

### Hugging Face

```
model/
  (repo)  <-- The repo inference code as direct child (no sub-folder)
  vae
  unet
  ...
```

- Refer [doc](https://huggingface.co/docs/inference-endpoints/guides/create_endpoint) to create endpoint.