Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch
Paper
•
2501.18512
•
Published
•
27
•
7
Arthur Douillard
ArthurDouillard
AI & ML interests
Continual Learning, Computer Vision, Transformers
Recent Activity
commented on
a paper
15 days ago
Streaming DiLoCo with overlapping communication: Towards a Distributed
Free Lunch
authored
a paper
21 days ago
Eager Updates For Overlapped Communication and Computation in DiLoCo
upvoted
a
paper
21 days ago
Eager Updates For Overlapped Communication and Computation in DiLoCo
Organizations
None yet
ArthurDouillard's activity
commented
a
paper
15 days ago
commented
a
paper
21 days ago