Mae'r model LLM yn seiliedig ar mistralai/Mistral-7B-v0.1, gyda hyfforddiant parhaus am 2 Epoch cyfan o ddata Cymreig o'r dataset allenai/MADLAD-400.

Pwrpas y model yw fod yn gychwyn i hyfforddiant cywrain pellach i greu casgliad o LLMs Cymreig penodol.

Contains information from allenai/MADLAD-400 which is made available under the ODC Attribution License.

Downloads last month: 2

Safetensors

Model size

7.24B params

Tensor type

BF16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

BangorAI
/

mistral-7b-cy-epoch-2

Dataset used to train BangorAI/mistral-7b-cy-epoch-2