Error while running hosted inference API

#8
by deleted - opened
deleted

Trying to run the default prompt on the hosted inference API yields an error:

The model_type 'gpt_bigcode' is not recognized. It could be a bleeding edge model, or incorrect

try to install these versions and run again
torch
transformers==4.28.0
datasets==2.7.0
huggingface-hub==0.11.0

The same error from the inference widget
Screenshot 2023-07-06 at 09.06.28.png

BigCode org

The inference API works now

loubnabnl changed discussion status to closed

Sign up or log in to comment