Hugging Face's logo

Spaces:
open-llm-leaderboard
/
open_llm_leaderboard
Running on CPU Upgrade

App Files Community
1146

Model evaluations failed

#884
by DavidGF - opened
Discussion
DavidGF

Hey,

it seems there was a network issue with the running queue?
Our Model failed on the evaluation:

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/VAGOsolutions/Llama-3.1-SauerkrautLM-70b-Instruct_eval_request_False_bfloat16_Original.json

Can you please add the models back into the running queue?

Thanks in advance!

alozowski
 Open LLM Leaderboard org

Hi @DavidGF ,

I have resubmitted your model, please, check the request file!

I will close this issue, please, ping me here if you need any help with this model again or open a new one

alozowski changed discussion status to closed
DavidGF

Hi @alozowski ,
unfortunately the model was kicked out of the queue again.
I would appreciate if you could reresubmit the model again :)

Many thanks in advance!

DavidGF

Hi @alozowski
I just want to kindly ask if there are any problems with our model on your side?
We did a subset of evaluations ourself with no issues at all.

Many thanks and regards,
David

alozowski changed discussion status to open
alozowski
 Open LLM Leaderboard org

Hi @DavidGF ,

According to the request file the status of your model is PENDING. Our research cluster is now full, so we ask for your patience while waiting for the results

alozowski changed discussion status to closed
eshanc

Hi @DavidGF not sure if this helpful but you can use Impulse AI (https://www.impulselabs.ai/) to fine-tune and deploy open source models models. we're basically a managed service that makes it super easy to fine-tune and run

Sign up or log in to comment