File size: 488 Bytes
2a0a31c |
1 2 3 4 5 6 7 8 9 10 |
---
license: mit
datasets:
- togethercomputer/RedPajama-Data-1T-Sample
language:
- en
library_name: transformers
---
This is a set of sparse autoencoders (SAEs) trained on the residual stream of [Llama 3 8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) using the [RedPajama corpus](https://huggingface.co/datasets/togethercomputer/RedPajama-Data-1T-Sample). The SAEs are organized by layer, and can be loaded using the EleutherAI [`sae` library](https://github.com/EleutherAI/sae). |