OSError: CohereForAI/c4ai-command-r-v01 does not appear to have a file named tokenization_cohere_fast.py.

#45
by epignatelli - opened

When running

tokenizer = AutoTokenizer.from_pretrained("CohereForAI/c4ai-command-r-v01", trust_remote_code=True)

I keep getting this error as soon as I try to instantiate the model:

OSError: CohereForAI/c4ai-command-r-v01 does not appear to have a file named tokenization_cohere_fast.py. Checkout 'https://huggingface.co/CohereForAI/c4ai-command-r-v01/main' for available files.

transformers:
v0.39.2

OS

NAME="Rocky Linux"
VERSION="9.3 (Blue Onyx)"
ID="rocky"
ID_LIKE="rhel centos fedora"
VERSION_ID="9.3"
PLATFORM_ID="platform:el9"
PRETTY_NAME="Rocky Linux 9.3 (Blue Onyx)"
ANSI_COLOR="0;32"
LOGO="fedora-logo-icon"
CPE_NAME="cpe:/o:rocky:rocky:9::baseos"
HOME_URL="https://rockylinux.org/"
BUG_REPORT_URL="https://bugs.rockylinux.org/"
SUPPORT_END="2032-05-31"
ROCKY_SUPPORT_PRODUCT="Rocky-Linux-9"
ROCKY_SUPPORT_PRODUCT_VERSION="9.3"
REDHAT_SUPPORT_PRODUCT="Rocky Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="9.3"

Never mind.

Removing trust_remote_code=True from the initialiser solved the issue.

epignatelli changed discussion status to closed
Cohere Labs org
This comment has been hidden
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment