SauerkrautLM's Multi-Phase Spectrum Training: A Technical Deep Dive
β’
9
David Golchinfar PRO
DavidGF
AI & ML interests
finetune llms, improve german language understanding and generated text of llms
Recent Activity
upvoted
an
article
3 days ago
DeepSeek R1 on how to build conscious AGI
liked
a model
3 days ago
NovaSky-AI/Sky-T1-32B-Flash
liked
a model
5 days ago
qresearch/Llama-3.2-1B-Instruct-SAE-l9
Articles
Organizations
DavidGF's activity
upvoted
an
article
3 days ago
Article
DeepSeek R1 on how to build conscious AGI
By
β’
β’
5
liked
a
model
3 days ago
liked
a
model
5 days ago
reacted to
sometimesanotion's
post with π
5 days ago
Post
2508
I've managed a #1 score of 41.22% average for 14B parameter models on the Open LLM Leaderboard. As of this writing, sometimesanotion/Lamarck-14B-v0.7 is #8 for all models up to 70B parameters.
It took a custom toolchain around Arcee AI's mergekit to manage the complex merges, gradients, and LoRAs required to make this happen. I really like seeing features of many quality finetunes in one solid generalist model.
It took a custom toolchain around Arcee AI's mergekit to manage the complex merges, gradients, and LoRAs required to make this happen. I really like seeing features of many quality finetunes in one solid generalist model.
- 5 replies
liked
a
model
7 days ago
liked
2
models
10 days ago
upvoted
2
articles
11 days ago
Article
Train 400x faster Static Embedding Models with Sentence Transformers
β’
124
Article
The Large Language Model Course
By
β’
β’
76
liked
a
model
12 days ago
liked
2
models
13 days ago
liked
a
model
15 days ago
liked
a
dataset
18 days ago
liked
2
models
19 days ago
liked
a
model
about 1 month ago
liked
2
datasets
about 1 month ago
upvoted
an
article
about 1 month ago
Article
**Intelligence Potentiation: An Evolutionary Perspective on AI Agent Designs**
By
β’
β’
4