Diffusers
Safetensors
AudioLDMPipeline
sanchit-gandhi commited on
Commit
c98f431
·
1 Parent(s): ebeda54

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -7
README.md CHANGED
@@ -17,15 +17,18 @@ is a text-to-audio _latent diffusion model (LDM)_ that learns continuous audio r
17
  latents. AudioLDM takes a text prompt as input and predicts the corresponding audio. It can generate text-conditional
18
  sound effects, human speech and music.
19
 
20
- This is the _medium_ version of the AudioLDM model. The three AudioLDM checkpoints are summarised in the table below.
21
 
22
- **Table 1:** Summary of the AudioLDM checkpoints. Frechet Distance (FD) indicates the similarity between generated samples and target samples, where lower is better.
23
 
24
- | Checkpoint | Training Data (h) | Training Steps | Params | Frechet Distance ↓ |
25
- |-----------------|-------------------|----------------|--------|-------------------------------|
26
- | AudioLDM-S | 137 | 0.6M | 181M | 29.48 |
27
- | AudioLDM-L | 137 | 0.6M | 739M | 27.12 |
28
- | AudioLDM-L-Full | 9174 | 1.5M | 739M | **23.31** |
 
 
 
29
 
30
  ## Model Sources
31
 
 
17
  latents. AudioLDM takes a text prompt as input and predicts the corresponding audio. It can generate text-conditional
18
  sound effects, human speech and music.
19
 
20
+ # Checkpoint Details
21
 
22
+ This is the **medium** version of the AudioLDM model, which has a larger UNet, CLAP audio projection dim, and is trained with audio embeddings as condition. The four AudioLDM checkpoints are summarised below:
23
 
24
+ **Table 1:** Summary of the AudioLDM checkpoints.
25
+
26
+ | Checkpoint | Training Data (h) | Training Steps | Params |
27
+ |-----------------------------------------------------------------------|-------------------|----------------|--------|
28
+ | [audioldm-s-full](https://huggingface.co/cvssp/audioldm) | 9174 | 1.5M | 421M |
29
+ | [audioldm-s-full-v2](https://huggingface.co/cvssp/audioldm-s-full-v2) | 9174 | > 1.5M | 421M |
30
+ | [audioldm-m-full](https://huggingface.co/cvssp/audioldm-m-full) | 9174 | 1.5M | 652M |
31
+ | [audioldm-l-full](https://huggingface.co/cvssp/audioldm-l-full) | 9174 | 1.5M | 975M |
32
 
33
  ## Model Sources
34