mistralai

/

Mistral-Small-24B-Instruct-2501

like 869

Follow

Mistral AI_ 6.18k

Getting HfApiJson error as below when using it with Chat-UI. How can we change it or fix it? Please suggest

    err: {
      "type": "Error",
      "message": "HfApiJson(Deserialize(Error(\"unknown variant `vllm`, expected one of `text-generation-inference`, `transformers`, `allennlp`, `flair`, `espnet`, `asteroid`, `speechbrain`, `timm`, `sentence-transformers`, `spacy`, `sklearn`, `stanza`, `adapter-transformers`, `fasttext`, `fairseq`, `pyannote-audio`, `doctr`, `nemo`, `fastai`, `k2`, `diffusers`, `paddlenlp`, `mindspore`, `open_clip`, `span-marker`, `bertopic`, `peft`, `setfit`\", line: 1, column: 153)))",
      "stack":
          Error: HfApiJson(Deserialize(Error("unknown variant `vllm`, expected one of `text-generation-inference`, `transformers`, `allennlp`, `flair`, `espnet`, `asteroid`, `speechbrain`, `timm`, `sentence-transformers`, `spacy`, `sklearn`, `stanza`, `adapter-transformers`, `fasttext`, `fairseq`, `pyannote-audio`, `doctr`, `nemo`, `fastai`, `k2`, `diffusers`, `paddlenlp`, `mindspore`, `open_clip`, `span-marker`, `bertopic`, `peft`, `setfit`", line: 1, column: 153)))
    }