AISE-TUDelft/Custom-Activations-BERT-Adaptive-GELU
Fill-Mask
•
Updated
•
3
BRP Tiny-Transformers
Models for the 2024-Q4 BSc. Research Project: "Architectural Decisions for Language Modelling with Small Transformers".
-
-
AISE-TUDelft/Custom-Activations-BERT-GELU
Fill-Mask • Updated • 2 -
AISE-TUDelft/Custom-Activations-BERT-PReLU
Fill-Mask • Updated -
AISE-TUDelft/Custom-Activations-BERT-ReLU
Fill-Mask • Updated • 1 -
AISE-TUDelft/Custom-Activations-BERT-SiLU
Fill-Mask • Updated • 1 -
AISE-TUDelft/Custom-Activations-BERT-Swish
Fill-Mask • Updated • 2 -
AISE-TUDelft/Custom-Activations-GPT-Adaptive-GELU
Text Generation • Updated • 16 -
AISE-TUDelft/Custom-Activations-GPT-GELU
Text Generation • Updated • 12 -
AISE-TUDelft/Custom-Activations-GPT-KAN
Text Generation • Updated • 14 -
AISE-TUDelft/Custom-Activations-GPT-PReLU
Text Generation • Updated • 14 -
AISE-TUDelft/Custom-Activations-GPT-ReLU
Text Generation • Updated • 27 -
AISE-TUDelft/Custom-Activations-GPT-SiLU
Text Generation • Updated • 13 -
AISE-TUDelft/Custom-Activations-GPT-Swish
Text Generation • Updated • 14