Zengzhi Wang

SinclairWang's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted 2 papers about 14 hours ago

Revisit Large-Scale Image-Caption Data in Pre-training Multimodal Foundation Models

Paper • 2410.02740 • Published 1 day ago • 41

VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment

Paper • 2410.01679 • Published 3 days ago • 17

upvoted 3 papers 3 days ago

A Survey on the Honesty of Large Language Models

Paper • 2409.18786 • Published 8 days ago • 28

Atlas-Chat: Adapting Large Language Models for Low-Resource Moroccan Arabic Dialect

Paper • 2409.17912 • Published 9 days ago • 18

TPI-LLM: Serving 70B-scale LLMs Efficiently on Low-resource Edge Devices

Paper • 2410.00531 • Published 4 days ago • 27

upvoted a collection 3 days ago

📑Trending Papers - September 9⃣️

Collection

10 items • Updated 3 days ago • 5

upvoted an article 3 days ago

view article

Article

RegMix: Data Mixture as Regression for Language Model Pre-training

By •

Jul 11

• 10

upvoted a paper 4 days ago

MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning

Paper • 2409.20566 • Published 4 days ago • 43

upvoted a paper 9 days ago

Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale

Paper • 2409.17115 • Published 9 days ago • 58

upvoted 2 papers 16 days ago

Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution

Paper • 2409.12191 • Published 16 days ago • 69

Qwen2.5-Coder Technical Report

Paper • 2409.12186 • Published 16 days ago • 120

upvoted a paper 24 days ago

Towards a Unified View of Preference Learning for Large Language Models: A Survey

Paper • 2409.02795 • Published about 1 month ago • 71

upvoted 2 papers 27 days ago

Power Scheduler: A Batch Size and Token Number Agnostic Learning Rate Scheduler

Paper • 2408.13359 • Published Aug 23 • 21

Data Contamination Report from the 2024 CONDA Shared Task

Paper • 2407.21530 • Published Jul 31 • 10

upvoted a paper 29 days ago

Arctic-SnowCoder: Demystifying High-Quality Data in Code Pretraining

Paper • 2409.02326 • Published Sep 3 • 16

upvoted 2 papers about 1 month ago

Learning to Move Like Professional Counter-Strike Players

Paper • 2408.13934 • Published Aug 25 • 21

Building and better understanding vision-language models: insights and future directions

Paper • 2408.12637 • Published Aug 22 • 111

upvoted a collection about 1 month ago

🪐 SmolLM

Collection

A series of smol LLMs: 135M, 360M and 1.7B. We release base and Instruct models as well as the training corpus and some WebGPU demos • 12 items • Updated Aug 18 • 174

upvoted 2 papers about 2 months ago

xGen-MM (BLIP-3): A Family of Open Large Multimodal Models

Paper • 2408.08872 • Published Aug 16 • 96

OpenResearcher: Unleashing AI for Accelerated Scientific Research

Paper • 2408.06941 • Published Aug 13 • 29

upvoted a paper 2 months ago

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies

Paper • 2407.13623 • Published Jul 18 • 52

upvoted a paper 3 months ago

ANOLE: An Open, Autoregressive, Native Large Multimodal Models for Interleaved Image-Text Generation

Paper • 2407.06135 • Published Jul 8 • 20

upvoted a paper 4 months ago

OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI

Paper • 2406.12753 • Published Jun 18 • 14

upvoted 2 papers 5 months ago

FLAME: Factuality-Aware Alignment for Large Language Models

Paper • 2405.01525 • Published May 2 • 24

Benchmarking Benchmark Leakage in Large Language Models

Paper • 2404.18824 • Published Apr 29 • 6

upvoted 2 papers 6 months ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22 • 251

Sailor: Open Language Models for South-East Asia

Paper • 2404.03608 • Published Apr 4 • 20

upvoted 2 papers 7 months ago

RLVF: Learning from Verbal Feedback without Overgeneralization

Paper • 2402.10893 • Published Feb 16 • 10

RewardBench: Evaluating Reward Models for Language Modeling

Paper • 2403.13787 • Published Mar 20 • 19

upvoted a collection 7 months ago

Model Merging

Collection

Model Merging is a very popular technique nowadays in LLM. Here is a chronological list of papers on the space that will help you get started with it! • 30 items • Updated Jun 12 • 212

upvoted 2 papers 8 months ago

StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback

Paper • 2402.01391 • Published Feb 2 • 41

Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research

Paper • 2402.00159 • Published Jan 31 • 59

upvoted 4 papers 9 months ago

Self-Rewarding Language Models

Paper • 2401.10020 • Published Jan 18 • 142

TOFU: A Task of Fictitious Unlearning for LLMs

Paper • 2401.06121 • Published Jan 11 • 14

TinyLlama: An Open-Source Small Language Model

Paper • 2401.02385 • Published Jan 4 • 89

Generative AI for Math: Part I -- MathPile: A Billion-Token-Scale Pretraining Corpus for Math

Paper • 2312.17120 • Published Dec 28, 2023 • 25

upvoted 2 papers 10 months ago

LIMA: Less Is More for Alignment

Paper • 2305.11206 • Published May 18, 2023 • 21

Magicoder: Source Code Is All You Need

Paper • 2312.02120 • Published Dec 4, 2023 • 79

upvoted 2 papers 11 months ago

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 120

Lemur: Harmonizing Natural Language and Code for Language Agents

Paper • 2310.06830 • Published Oct 10, 2023 • 30

upvoted 2 papers 12 months ago

Llemma: An Open Language Model For Mathematics

Paper • 2310.10631 • Published Oct 16, 2023 • 49

Ask Again, Then Fail: Large Language Models' Vacillations in Judgement

Paper • 2310.02174 • Published Oct 3, 2023 • 3

upvoted 6 papers about 1 year ago

MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models

Paper • 2309.12284 • Published Sep 21, 2023 • 18

When Less is More: Investigating Data Pruning for Pretraining LLMs at Scale

Paper • 2309.04564 • Published Sep 8, 2023 • 15

Textbooks Are All You Need II: phi-1.5 technical report

Paper • 2309.05463 • Published Sep 11, 2023 • 86

Textbooks Are All You Need

Paper • 2306.11644 • Published Jun 20, 2023 • 143

The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open World

Paper • 2308.01907 • Published Aug 3, 2023 • 10

Is ChatGPT a Good Sentiment Analyzer? A Preliminary Study

Paper • 2304.04339 • Published Apr 10, 2023 • 1