RichardErkhov/LSX-UniWue_-_LLaMmlein_1B-awq

Quantization made by Richard Erkhov.

Github

Discord

Request more models

LLaMmlein_1B - AWQ

• Model creator: https://huggingface.co/LSX-UniWue/
• Original model: https://huggingface.co/LSX-UniWue/LLaMmlein_1B/

Original model description:

datasets: - togethercomputer/RedPajama-Data-V2 language: - de pipeline_tag: text-generation library_name: transformers license: other

LLäMmlein 1B

This is a German Tinyllama 1B language model trained from scratch using the Tinyllama codebase on the German portion of RedPajama V2. Find more details on our page and our preprint!

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("LSX-UniWue/LLaMmlein_1B")

tokenizer = AutoTokenizer.from_pretrained("LSX-UniWue/LLaMmlein_1B")

Evaluation

We evaluated our results on the SuperGLEBer benchmark.