sylvain471/llama-3.1-8b-math-orca-qlora-10k-ep1
Updated
•
6
Sylvain Delahaies
sylvain471
AI & ML interests
None yet
Recent Activity
updated
a model
about 19 hours ago
sylvain471/llama-3.1-8b-math-orca-qlora-10k-ep1
published
a model
about 19 hours ago
sylvain471/llama-3.1-8b-math-orca-qlora-10k-ep1
updated
a model
about 20 hours ago
sylvain471/llama-3-1-8b-math-orca-qlora-10k-ep1
Organizations
sylvain471's activity
updated
a
model
about 19 hours ago
published
a
model
about 19 hours ago
updated
a
model
about 20 hours ago
published
a
model
about 22 hours ago
updated
a
model
1 day ago
published
a
model
1 day ago
updated
a
model
3 days ago
published
a
model
3 days ago
upvoted
an
article
11 days ago
Article
Run ComfyUI workflows for free on Spaces
•
51
reacted to
Jaward's
post with 👍
24 days ago
Post
1871
minimal single script implementation of knowledge distillation in LLMs. In this implementation, we use GPT-2 (124M) as student model and GPT-2 Medium (340M) as teacher via reverse Kullback-Leibler (KL) divergence, trained on a small chunk of openwebtext.
Code: https://github.com/Jaykef/ai-algorithms/blob/main/llm_knowledge_distillation.ipynb
Code: https://github.com/Jaykef/ai-algorithms/blob/main/llm_knowledge_distillation.ipynb
upvoted
an
article
26 days ago
Article
The LASER technique: Evaluating SVD compression
By
•
•
8
SmolLm and mergekit_moe: is lm_head missing ?
6
#14 opened 5 months ago
by
sylvain471
updated
a
model
3 months ago
updated
a
dataset
3 months ago
Librarian Bot: Add language metadata for dataset
#2 opened 3 months ago
by
librarian-bot
[bot] Conversion to Parquet
#1 opened 3 months ago
by
parquet-converter
updated
a
dataset
4 months ago
updated
a
model
4 months ago
updated
a
Space
4 months ago
updated
a
model
4 months ago