
Foundation Text-Generation Models Below 360M Parameters
Great candidates for fine-tuning targeting Wllama and Transformers.js for mobile devices, ordered by number of parameters.
Text Generation • Updated • 15.8k • • 38Note License: apache-2.0
OuteAI/Lite-Oute-1-300M
Text Generation • Updated • 361 • 7Note License: apache-2.0
keeeeenw/MicroLlama
Text Generation • Updated • 1.13k • 42Note License: apache-2.0
cerebras/Cerebras-GPT-256M
Text Generation • Updated • 2.05k • 25Note License: apache-2.0
upstage/TinySolar-248m-4k
Text Generation • Updated • 790 • 5Note License: apache-2.0
M4-ai/TinyMistral-248M-v3
Text Generation • Updated • 234 • 6Note License: apache-2.0
MiniLLM/MiniPLM-llama3.1-212M
Text Generation • Updated • 942 • 2Note License: apache-2.0
MiniLLM/MiniPLM-Qwen-200M
Text Generation • Updated • 294 • 2Note License: apache-2.0
princeton-nlp/Sheared-Pythia-160m
Text Generation • Updated • 99 • 4Note License: apache-2.0
JackFram/llama-160m
Text Generation • Updated • 256k • 33Note License: apache-2.0
SmallDoge/Doge-160M
Text Generation • Updated • 4.87k • 2Note License: apache-2.0
EleutherAI/pythia-160m
Text Generation • Updated • 167k • • 29Note License: apache-2.0
HuggingFaceTB/SmolLM-135M
Text Generation • Updated • 170k • • 196Note License: apache-2.0
amd/AMD-Llama-135m
Text Generation • Updated • 18.4k • • 111Note License: apache-2.0
MiniLLM/MiniPLM-Mamba-130M
Text Generation • Updated • 107 • 2Note License: apache-2.0
EleutherAI/gpt-neo-125m
Text Generation • Updated • 121k • • 196Note License: mit
cerebras/Cerebras-GPT-111M
Text Generation • Updated • 4.56k • • 76Note License: apache-2.0
BEE-spoke-data/smol_llama-101M-GQA
Text Generation • Updated • 5.02k • • 28Note License: apache-2.0
openai-community/gpt2
Text Generation • Updated • 16.7M • • 2.59kNote License: mit
distilbert/distilgpt2
Text Generation • Updated • 1.75M • • 486Note License: apache-2.0
weiser/82M-0.4
Text Generation • Updated • 64Note License: apache-2.0
BEE-spoke-data/smol_llama-81M-tied
Text Generation • Updated • 2.97k • 6Note License: apache-2.0
EleutherAI/pythia-70m
Updated • 60.1k • 64Note License: apache-2.0
JackFram/llama-68m
Text Generation • Updated • 523k • 26Note License: apache-2.0
OuteAI/Lite-Oute-1-65M
Text Generation • Updated • 223 • 9Note License: apache-2.0
SmallDoge/Doge-60M
Text Generation • Updated • 75.5k • 4Note License: apache-2.0
Felladrin/Minueza-32M-Base
Text Generation • Updated • 469 • 16Note License: apache-2.0
GerbilLab/Gerbil-A-32m
Text Generation • Updated • 167 • 2Note License: apache-2.0
EleutherAI/pythia-31m
Text Generation • Updated • 10.8k • 5Note License: apache-2.0
SmallDoge/Doge-20M
Text Generation • Updated • 72k • 7Note License: apache-2.0
EleutherAI/pythia-14m
Text Generation • Updated • 129k • 20Note License: apache-2.0