Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch
Paper
•
2501.18512
•
Published
•
20
•
5
Arthur Douillard
ArthurDouillard
AI & ML interests
Continual Learning, Computer Vision, Transformers
Recent Activity
commented on
a paper
1 day ago
Streaming DiLoCo with overlapping communication: Towards a Distributed
Free Lunch
upvoted
a
paper
2 days ago
Streaming DiLoCo with overlapping communication: Towards a Distributed
Free Lunch
commented on
a paper
2 days ago
Streaming DiLoCo with overlapping communication: Towards a Distributed
Free Lunch
Organizations
None yet
ArthurDouillard's activity
commented
a
paper
1 day ago
upvoted
a
paper
2 days ago
commented
a
paper
2 days ago
upvoted
2
papers
6 months ago
upvoted
a
paper
7 months ago
authored
4
papers
7 months ago
DiLoCo: Distributed Low-Communication Training of Language Models
Paper
•
2311.08105
•
Published
•
15
NEVIS'22: A Stream of 100 Tasks Sampled from 30 Years of Computer Vision Research
Paper
•
2211.11747
•
Published
PODNet: Pooled Outputs Distillation for Small-Tasks Incremental Learning
Paper
•
2004.13513
•
Published
WARP: On the Benefits of Weight Averaged Rewarded Policies
Paper
•
2406.16768
•
Published
•
23
upvoted
a
paper
7 months ago
authored
a
paper
11 months ago
upvoted
a
paper
about 1 year ago
authored
a
paper
about 1 year ago
upvoted
a
paper
about 1 year ago