gmongaras
/

Softmax_Attention_GPT_1.2B

Feature Extraction

Model card Files Files and versions Community

Softmax_Attention_GPT_1.2B / README.md

gmongaras's picture

Update README.md

ee57702 verified 5 months ago

|

history blame contribute delete

215 Bytes

	---
	license: mit
	pipeline_tag: feature-extraction
	---

	This repository contains the GPT-Soft-1.2b model described in [Cottention: Linear Transformers With Cosine Attention](https://huggingface.co/papers/2409.18747).