metadata
license: mit
tags:
- unconditional-image-generation
Fashion MNIST unconditional Unet Model trained using DDPM
Model Hyperparams:
- Model size: 51,834,625 params
- 3 stages: 128, 256, 512 channels
- Linear Attention in 2nd and 3rd stages, Self Attention in Middle Stage
- Optimizer: Adam
- LR: 3e-4
- Batch Size: 64
- Grad Accumulation: 8 steps
- Effectibe Batch Size: 512
- Total steps: 5,000
- Linear Beta Schedule: 1000 Steps
