6 26 78

neuralink

AI & ML interests

nanotron @ hf

Recent Activity

upvoted an article 5 days ago

Open-source DeepResearch – Freeing our search agents

liked a Space 5 days ago

m-ric/open_Deep-Research

new activity 5 days ago

nanotron/ultrascale-playbook:More ressources

View all activity

Organizations

neuralink's activity

upvoted an article 5 days ago

Article

Open-source DeepResearch – Freeing our search agents

22 days ago

• 1.1k

upvoted an article 20 days ago

Article

Open-R1: a fully open reproduction of DeepSeek-R1

29 days ago

• 773

upvoted an article 21 days ago

Article

Open-R1: Update #1

and 7 others •

24 days ago

• 287

upvoted a paper about 1 month ago

Domino: Eliminating Communication in LLM Training via Generic Tensor Slicing and Overlapping

Paper • 2409.15241 • Published Sep 23, 2024 • 1

upvoted a paper about 2 months ago

Scaling Laws for Floating Point Quantization Training

Paper • 2501.02423 • Published Jan 5 • 26

upvoted a paper 3 months ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22, 2024 • 256

upvoted a paper 6 months ago

Small-scale proxies for large-scale Transformer training instabilities

Paper • 2309.14322 • Published Sep 25, 2023 • 20

upvoted an article 6 months ago

Article

How NuminaMath Won the 1st AIMO Progress Prize

Jul 11, 2024

• 117

upvoted a paper 6 months ago

Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

Paper • 2201.02177 • Published Jan 6, 2022 • 2

upvoted an article 6 months ago

Article

A failed experiment: Infini-Attention, and why we should keep trying?

Aug 14, 2024

• 59

upvoted 2 papers 7 months ago

Grokfast: Accelerated Grokking by Amplifying Slow Gradients

Paper • 2405.20233 • Published May 30, 2024 • 6

Transformer Explainer: Interactive Learning of Text-Generative Models

Paper • 2408.04619 • Published Aug 8, 2024 • 159

upvoted a paper 8 months ago

What matters when building vision-language models?

Paper • 2405.02246 • Published May 3, 2024 • 102

upvoted a paper 9 months ago

DiPaCo: Distributed Path Composition

Paper • 2403.10616 • Published Mar 15, 2024 • 13

upvoted 2 articles 9 months ago

Article

Putting RL back in RLHF

Jun 12, 2024

• 76

Article

Let's talk about LLM evaluation

•

May 23, 2024

• 153

upvoted 3 papers 11 months ago

upvoted a paper 12 months ago

MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs

Paper • 2402.15627 • Published Feb 23, 2024 • 35