open-llm-leaderboard/open_llm_leaderboard

#1101 opened 12 days ago by

SandInTheDunes

Spurious `trust_remote_code=True` objection when submitting a model?

#1100 opened 13 days ago by

grimjim

Can we add model layers?

#1098 opened 14 days ago by

Blazgo

[FLAG] contamination MATH `bond005/meno-tiny-0.1`

#1094 opened 18 days ago by

fblgit

Need help doing eval- they keep failing

#1083 opened 27 days ago by

SicariusSicariiStuff

Unable to submit byroneverson/Yi-1.5-34B-Chat-abliterated

#1080 opened about 1 month ago by

CombinHorizon

Qwen2.5-32B merge eval error

#1078 opened about 1 month ago by

ehristoforu

Model results missing

#1075 opened about 1 month ago by

maldv

Suggestion

#1073 opened about 1 month ago by

zelk12

fix-gptq

#1072 opened about 1 month ago by

alozowski

Bug in Parameters count for GPTQ quantized model

#1068 opened about 2 months ago by

Qubitium

Resubmitting a model to use `chat_template` doesn't re-evaluate, but does change `chat_template` column

#1066 opened about 2 months ago by

xzuyn

failed models, check logs

#1062 opened about 2 months ago by

CombinHorizon

docker-container-test

#1047 opened 2 months ago by

alozowski

Normalization for MuSR object placement

#1040 opened 2 months ago by

recojt

update ranking number when editing filters

#1036 opened 3 months ago by

clem

Requested feature: searchable tags for official supported languages for each model.

#1035 opened 3 months ago by

Reza2kn

Proposal for new column

#1032 opened 3 months ago by

Yuma42

I can't replicate results.

5

#1016 opened 4 months ago by

Pretergeek

merged models marked as non merged in the leaderboard

#993 opened 4 months ago by

fblgit

Feature Request: change request file format to disambiguate chat and non-chat models?

#954 opened 5 months ago by

CombinHorizon

Feature request: Add toggle to only show models with linked dataset

#763 opened 9 months ago by

ThiloteE

Feature request: Hide models with insufficient model card from default view in leaderboard

#762 opened 9 months ago by

ThiloteE

Discussion: naming pattern to converge on to better identify fine-tunes

17

#761 opened 9 months ago by

ThiloteE

Crowd-Source Hardware for the LeaderBoard?

#570 opened about 1 year ago by

ibivibiv

Feature request: Using weights hash to identify duplicates

#422 opened about 1 year ago by

mrfakename

Tool: Adding evaluation results to model cards

47

#370 opened over 1 year ago by

Weyaxi

Feature suggestion: average of selected (rather than all) columns