NevIR: Negation in Neural Information Retrieval
Paper
•
2305.07614
•
Published
DataComp
non-profit
AI & ML interests
None defined yet.
Recent Activity
View all activity
dclm's activity
orionweller
authored
8
papers
6 days ago
Learning from Task Descriptions
Paper
•
2011.08115
•
Published
MegaWika: Millions of reports and their sources across 50 diverse languages
Paper
•
2307.07049
•
Published
Defending Against Poisoning Attacks in Open-Domain Question Answering
Paper
•
2212.10002
•
Published
Learning to Reason via Program Generation, Emulation, and Search
Paper
•
2405.16337
•
Published
CLERC: A Dataset for Legal Case Retrieval and Retrieval-Augmented Analysis Generation
Paper
•
2406.17186
•
Published
•
1
Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models
Paper
•
2409.11136
•
Published
•
21
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference
Paper
•
2412.13663
•
Published
•
103
AmeyaPrabhu
authored
a
paper
9 days ago
ranpox
authored
a
paper
12 days ago
hlzhang109
authored
5
papers
14 days ago
Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmark
Paper
•
2304.03279
•
Published
•
1
CoLoR-Filter: Conditional Loss Reduction Filtering for Targeted Language Model Pre-training
Paper
•
2406.10670
•
Published
•
4
DataComp-LM: In search of the next generation of training sets for language models
Paper
•
2406.11794
•
Published
•
50
Eliminating Position Bias of Language Models: A Mechanistic Approach
Paper
•
2407.01100
•
Published
•
6
Mind the Gap: Examining the Self-Improvement Capabilities of Large Language Models
Paper
•
2412.02674
•
Published
Post
4326
We are proud to announce
HuggingFaceFW/fineweb-2: A sparkling update to
HuggingFaceFW/fineweb with 1000s of 🗣️languages.
We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages.
🥂 FineWeb2 has 8TB of compressed text data and outperforms other multilingual datasets in our experiments.
The dataset is released under the permissive 📜 ODC-By 1.0 license, and the 💻 code to reproduce it and our evaluations is public.
We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned!
In the mean time come ask us question on our chat place: HuggingFaceFW/discussion
H/t @guipenedo @hynky @lvwerra as well as @vsabolcec Bettina Messmer @negar-foroutan and @mjaggi
We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages.
🥂 FineWeb2 has 8TB of compressed text data and outperforms other multilingual datasets in our experiments.
The dataset is released under the permissive 📜 ODC-By 1.0 license, and the 💻 code to reproduce it and our evaluations is public.
We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned!
In the mean time come ask us question on our chat place: HuggingFaceFW/discussion
H/t @guipenedo @hynky @lvwerra as well as @vsabolcec Bettina Messmer @negar-foroutan and @mjaggi
- 2 replies
christopher
posted
an
update
17 days ago
Post
1562
The folks at Foursquare released a dataset of 104.5 million places of interest (
foursquare/fsq-os-places) and here's all of them on a plot
-
- 3 replies
christopher
posted
an
update
19 days ago
Post
2313
The Lichess database of games, puzzles, and engine evaluations is now on the Hub: https://huggingface.co/Lichess
Billions of chess data points to download, query, and stream and we're excited to see what you'll build with it! ♟️ 🤗
- Lichess/positions-datasets-66f50837db5cd3287d60d489
- Lichess/games-datasets-66f508df78f4b43e1bb2d353
Billions of chess data points to download, query, and stream and we're excited to see what you'll build with it! ♟️ 🤗
- Lichess/positions-datasets-66f50837db5cd3287d60d489
- Lichess/games-datasets-66f508df78f4b43e1bb2d353
ranpox
authored
a
paper
19 days ago
Post
883
Exponentially growing number of open-source AI models over the course of the past 30 months – from a few thousands to over 1 million and more
Interactive data viz: huggingface/open-source-ai-year-in-review-2024
Interactive data viz: huggingface/open-source-ai-year-in-review-2024