OSError: CohereForAI/c4ai-command-r-v01 does not appear to have a file named tokenization_cohere_fast.py.
#45
by
epignatelli
- opened
When running
tokenizer = AutoTokenizer.from_pretrained("CohereForAI/c4ai-command-r-v01", trust_remote_code=True)
I keep getting this error as soon as I try to instantiate the model:
OSError: CohereForAI/c4ai-command-r-v01 does not appear to have a file named tokenization_cohere_fast.py. Checkout 'https://huggingface.co/CohereForAI/c4ai-command-r-v01/main' for available files.
transformers:v0.39.2
OS
NAME="Rocky Linux"
VERSION="9.3 (Blue Onyx)"
ID="rocky"
ID_LIKE="rhel centos fedora"
VERSION_ID="9.3"
PLATFORM_ID="platform:el9"
PRETTY_NAME="Rocky Linux 9.3 (Blue Onyx)"
ANSI_COLOR="0;32"
LOGO="fedora-logo-icon"
CPE_NAME="cpe:/o:rocky:rocky:9::baseos"
HOME_URL="https://rockylinux.org/"
BUG_REPORT_URL="https://bugs.rockylinux.org/"
SUPPORT_END="2032-05-31"
ROCKY_SUPPORT_PRODUCT="Rocky-Linux-9"
ROCKY_SUPPORT_PRODUCT_VERSION="9.3"
REDHAT_SUPPORT_PRODUCT="Rocky Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="9.3"
Never mind.
Removing trust_remote_code=True
from the initialiser solved the issue.
epignatelli
changed discussion status to
closed
This comment has been hidden