Pretrained PLMs
Collection
11 items
•
Updated
Encoder only version of the ANKH base model (paper). The encoder only version is ideal for protein representation tasks.
To download
from transformers import T5EncoderModel, AutoTokenizer
model_path = 'Synthyra/ANKH_base'
model = T5EncoderModel.from_pretrained(model_path)
tokenizer = AutoTokenizer.from_pretrained(model_path)
We are working on implementing a version of T5 based PLMs with Flex attention once learned relative position bias is supported (used in T5). Stay tuned.
- Downloads last month
- 50
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no pipeline_tag.