Update description3.md
Browse files- description3.md +12 -6
description3.md
CHANGED
@@ -1,8 +1,14 @@
|
|
1 |
We showcase the building block of each alternative schedules below.
|
2 |
|
3 |
-
|
4 |
-
|
5 |
-
<img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/
|
6 |
-
|
7 |
-
|
8 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
We showcase the building block of each alternative schedules below.
|
2 |
|
3 |
+
### 1F1B-V:
|
4 |
+
|
5 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/TXf74JGHaqanCcMm_jPbw.jpeg" width="690px"/>
|
6 |
+
|
7 |
+
### Zero Bubble schedule with 2/3 1F1B memory:
|
8 |
+
|
9 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/TCCgzQEwjLDO3_12OUzmN.jpeg" width="480px"/>
|
10 |
+
|
11 |
+
### Variation of Interleaved 1F1B schedule:
|
12 |
+
|
13 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/AwXeE4e0HO20u_YJV23AN.jpeg" width="719px"/>
|
14 |
+
|