Stefan Schweter's picture

In a Training Loop 🔄

Stefan Schweter PRO

stefan-it

·

https://schweter.bayern

AI & ML interests

Flair Library 💕, NER & PoS Tagging, LM Pretraining (mostly encoder-only & encoder-decoder), Historical Language Models, German Language Models, Bavarian NLP 🥨

Recent Activity

upvoted a paper 3 days ago

Introducing TrGLUE and SentiTurca: A Comprehensive Benchmark for Turkish General Language Understanding and Sentiment Analysis

commented on an article 4 days ago

The Optimal Architecture for Small Language Models

upvoted an article 6 days ago

The Optimal Architecture for Small Language Models

View all activity

Organizations

commented a paper 13 days ago

Bolmo: Byteifying the Next Generation of Language Models

Paper • 2512.15586 • Published 15 days ago • 12 •

commented a paper about 1 month ago

Beyond URLs: Metadata Diversity and Position for Efficient LLM Pretraining

Paper • 2511.21613 • Published Nov 26, 2025 • 2 •

New activity in pdelobelle/baguettotron-nl about 1 month ago

Fine-Tuning example

#1 opened about 1 month ago by

New activity in enguard/multi-lingual-prompt-moderation about 2 months ago

Data Quality

#2 opened about 2 months ago by

commented 2 papers 2 months ago

Gaperon: A Peppered English-French Generative Language Model Suite

Paper • 2510.25771 • Published Oct 29, 2025 • 15 •

Mask and You Shall Receive: Optimizing Masked Language Modeling For Pretraining BabyLMs

Paper • 2510.20475 • Published Oct 23, 2025 • 1 •

New activity in nanochat-students/README 2 months ago

🥦 Pretraining Thread

#2 opened 3 months ago by

New activity in karpathy/nanochat-d32 2 months ago

transformers-implementation

#1 opened 3 months ago by

commented a paper 2 months ago

The Art of Asking: Multilingual Prompt Optimization for Synthetic Data

Paper • 2510.19806 • Published Oct 22, 2025 • 1 •

New activity in HuggingFaceFW/finewiki 2 months ago

docs: fix typo

#2 opened 2 months ago by

commented a paper 2 months ago

Empirical Evaluation of Knowledge Distillation from Transformers to Subquadratic Language Models

Paper • 2504.14366 • Published Apr 19, 2025 • 1 •

commented a paper 3 months ago

The German Commons - 154 Billion Tokens of Openly Licensed Text for German Language Models

Paper • 2510.13996 • Published Oct 15, 2025 • 8 •

New activity in bavarian-nlp/baivaria-v1 4 months ago

Adding `safetensors` variant of this model

#1 opened 4 months ago by

commented 6 papers 4 months ago

Llama-GENBA-10B: A Trilingual Large Language Model for German, English and Bavarian

Paper • 2509.05668 • Published Sep 6, 2025 • 5 •

KL3M Tokenizers: A Family of Domain-Specific and Character-Level Tokenizers for Legal, Financial, and Preprocessing Applications

Paper • 2503.17247 • Published Mar 21, 2025 • 1 •

German4All - A Dataset and Model for Readability-Controlled Paraphrasing in German

Paper • 2508.17973 • Published Aug 25, 2025 • 1 •

German4All - A Dataset and Model for Readability-Controlled Paraphrasing in German

Paper • 2508.17973 • Published Aug 25, 2025 • 1 •

German4All - A Dataset and Model for Readability-Controlled Paraphrasing in German

Paper • 2508.17973 • Published Aug 25, 2025 • 1 •

Tokens with Meaning: A Hybrid Tokenization Approach for NLP

Paper • 2508.14292 • Published Aug 19, 2025 • 1 •

New activity in flair/ner-french 5 months ago

docs: fix import and usage of French NER dataset

#2 opened 5 months ago by