Spaces:

open-llm-leaderboard
/

open_llm_leaderboard

Running on CPU Upgrade

App Files Files Community

1016

model evaluation failed

#929

by FuJhen - opened Sep 13

Discussion

FuJhen

Sep 13

•

edited Sep 14

Hello team,

I getting failed error,

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/FuJhen/ft-openhermes-25-mistral-7b-irca-dpo-pairs_eval_request_False_bfloat16_Adapter.json

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/FuJhen/mistral-instruct-7B-DPO_eval_request_False_bfloat16_Adapter.json

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/FuJhen/mistral_7b_v0.1_structedData_viggo_eval_request_False_bfloat16_Adapter.json

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/FuJhen/mistral_7b_v0.1_structedData_e2e_eval_request_False_bfloat16_Adapter.json

What is the status?
Could you please reveal the failing reason or resubmit it?

Thanks.

alozowski

Open LLM Leaderboard org Sep 17

Hi @FuJhen ,

Thank you for this discussion as I've been closely monitoring the evaluation of adapter models in recent weeks to make sure they run smoothly.

You can find your first two models on the Leaderboard now, please, checkout my screenshot. For the second two I've resubmitted them and we can expect the results in a couple of days. Please, feel free to ping me here if they fail again, but I hope the evaluation will be fine.

alozowski changed discussion status to closed Sep 17

alozowski

Open LLM Leaderboard org Sep 19

UPD: you can find all your models on the Leaderboard now! 🤗

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment