HF_ColBERT

#7
by PondY957 - opened

I cannot import HF_ColBERT from transformers, even the latest version. How does it work?

Jina AI org

hi HF_ColBERT is a class wrapper from ColBERT repo: https://github.com/stanford-futuredata/ColBERT which attached an additional linear layer. If you use the official ColBERT repo it should work

PondY957 changed discussion status to closed
PondY957 changed discussion status to open

from transformers import AutoTokenizer, HF_ColBERT

tokenizer = AutoTokenizer.from_pretrained("jinaai/jina-colbert-v1-en", trust_remote_code=True)
model = HF_ColBERT.from_pretrained("jinaai/jina-colbert-v1-en", trust_remote_code=True)

The above is an example of usage given by huggingface. How should I use it like this if I utilize the official ColBERT repo? I need to use it offline.

Sign up or log in to comment