Cosine Attention (Cottention)
Collection
Models for the paper Cottention: Linear Transformers With Cosine Attention https://arxiv.org/abs/2409.18747
•
6 items
•
Updated
This repository contains the GPT-Cos-300m model described in Cottention: Linear Transformers With Cosine Attention.
- Downloads last month
- 9
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.