LLM Blender

llm-blender's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts

yuchenlin 

authored a paper about 2 months ago

On Memorization of Large Language Models in Logical Reasoning

Paper • 2410.23123 • Published Oct 30 • 18

DongfuJiang 

authored a paper 2 months ago

MEGA-Bench: Scaling Multimodal Evaluation to over 500 Real-World Tasks

Paper • 2410.10563 • Published Oct 14 • 38

yuchenlin 

authored 2 papers 6 months ago

WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs

Paper • 2406.18495 • Published Jun 26 • 12

MantisScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation

Paper • 2406.15252 • Published Jun 21 • 14

DongfuJiang 

authored 2 papers 6 months ago

MantisScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation

Paper • 2406.15252 • Published Jun 21 • 14

WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences

Paper • 2406.11069 • Published Jun 16 • 13

yuchenlin 

authored a paper 6 months ago

WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences

Paper • 2406.11069 • Published Jun 16 • 13

yuchenlin 

authored 2 papers 7 months ago

Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing

Paper • 2406.08464 • Published Jun 12 • 65

WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild

Paper • 2406.04770 • Published Jun 7 • 27

DongfuJiang 

authored a paper 7 months ago

GenAI Arena: An Open Evaluation Platform for Generative Models

Paper • 2406.04485 • Published Jun 6 • 20

yuchenlin 

posted an update 7 months ago

view post

Post

2386

Introducing **BaseChat**!
https://huggingface.co/spaces/allenai/BaseChat_URIAL

This is a demo for our URIAL paper that enables base LLMs to chat with in-context alignment. You can talk directly with base, untuned LLMs to find out what knowledge and skills they have already learned from pre-training instead of SFT or xPO or RLHF. Also, you can use this to explore the pre-training data of base LLMs by chatting! I found a very interesting case: Base version of Llama-3-8B often thinks it is built by OpenAI, lol.

• 

🔥

4

4

🚀

2

2

🤗

2

2

❤️

2

2

+

Reply

DongfuJiang 

authored a paper 8 months ago

MANTIS: Interleaved Multi-Image Instruction Tuning

Paper • 2405.01483 • Published May 2 • 6

yuchenlin 

authored a paper 8 months ago

Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models

Paper • 2405.01535 • Published May 2 • 119

DongfuJiang 

updated a Space 8 months ago

Runtime error

9

⚡

LLM Blender

DongfuJiang 

authored a paper 8 months ago

VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluation

Paper • 2312.14867 • Published Dec 22, 2023 • 1

DongfuJiang 

updated a dataset 9 months ago

llm-blender/Unified-Feedback

Viewer • Updated Mar 31 • 1.79M • 386 • 16

yuchenlin 

authored a paper 9 months ago

RewardBench: Evaluating Reward Models for Language Modeling

Paper • 2403.13787 • Published Mar 20 • 21

yuchenlin 

authored 3 papers 10 months ago

Trial and Error: Exploration-Based Trajectory Optimization for LLM Agents

Paper • 2403.02502 • Published Mar 4 • 3

SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding

Paper • 2402.08983 • Published Feb 14 • 2

OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement

Paper • 2402.14658 • Published Feb 22 • 82