ZR0zNqSGMI (mlo-data-cleaning)

vsabolcec

updated a Space 2 months ago

Sleeping

6

🏢

Annotation

lvwerra

authored a paper 2 months ago

SelfCodeAlign: Self-Alignment for Code Generation

Paper • 2410.24198 • Published Oct 31, 2024 • 23

lvwerra

authored a paper 7 months ago

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25, 2024 • 90

hynky

authored a paper 7 months ago

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25, 2024 • 90

guipenedo

authored a paper 7 months ago

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25, 2024 • 90

lvwerra

authored a paper 8 months ago

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations

Paper • 2405.18392 • Published May 28, 2024 • 12

lvwerra

authored a paper 11 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29, 2024 • 136

hynky

authored a paper about 1 year ago

A Dataset and Strong Baselines for Classification of Czech News Texts

Paper • 2307.10666 • Published Jul 20, 2023

guipenedo

authored a paper about 1 year ago

The Falcon Series of Open Language Models

Paper • 2311.16867 • Published Nov 28, 2023 • 13

mjaggi

authored 5 papers about 1 year ago

lvwerra

authored a paper about 1 year ago

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 123

lvwerra

authored a paper over 1 year ago

OctoPack: Instruction Tuning Code Large Language Models

Paper • 2308.07124 • Published Aug 14, 2023 • 28

guipenedo

authored a paper over 1 year ago

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only

Paper • 2306.01116 • Published Jun 1, 2023 • 32

lvwerra

authored 2 papers almost 2 years ago

The Stack: 3 TB of permissively licensed source code

Paper • 2211.15533 • Published Nov 20, 2022 • 5

Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements

Paper • 2210.01970 • Published Sep 30, 2022 • 11

mlo-data-cleaning

AI & ML interests

ZR0zNqSGMI's activity

Annotation

SelfCodeAlign: Self-Alignment for Code Generation

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations

StarCoder 2 and The Stack v2: The Next Generation

A Dataset and Strong Baselines for Classification of Czech News Texts

The Falcon Series of Open Language Models

Model Fusion via Optimal Transport

Evaluating the Search Phase of Neural Architecture Search

Second-order optimization with lazy Hessians

Landmark Attention: Random-Access Infinite Context Length for Transformers

Faster Causal Attention Over Large Sequences Through Sparse Flash Attention

Zephyr: Direct Distillation of LM Alignment

OctoPack: Instruction Tuning Code Large Language Models

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only

The Stack: 3 TB of permissively licensed source code

Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements

AI & ML interests

Team members 8

ZR0zNqSGMI's activity

Annotation