---
pipeline_tag: text-generation
---

This repository contains weights of the paper [What Matters in Transformers? Not All Attention is Needed](https://huggingface.co/papers/2406.15786).