|
--- |
|
license: mit |
|
tags: |
|
- unconditional-image-generation |
|
--- |
|
Fashion MNIST unconditional Unet Model trained using DDPM |
|
|
|
Model Hyperparams: |
|
|
|
- Model size: 51,834,625 params |
|
- 3 stages: 128, 256, 512 channels |
|
- Linear Attention in 2nd and 3rd stages, Self Attention in Middle Stage |
|
- Optimizer: Adam |
|
- LR: 3e-4 |
|
- Batch Size: 64 |
|
- Grad Accumulation: 8 steps |
|
- Effectibe Batch Size: 512 |
|
- Total steps: 5,000 |
|
- Linear Beta Schedule: 1000 Steps |
|
|
|
 |
