We trained these skip-transcoders using signum, over 1B tokens. Trained with input and output normalized.

Downloads last month
3
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train EleutherAI/skip-transcoder-SmolLM2-135M-128x