This is another training run of SmolLlamix-8x101M with slightly different hyperparameters. Just testing to see how it holds up against the first run.

Downloads last month
1,279
Safetensors
Model size
399M params
Tensor type
BF16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for chargoddard/SmolLlamix-8x101M-take2

Quantizations
2 models

Dataset used to train chargoddard/SmolLlamix-8x101M-take2