Hugging Face's logo
Daniel Dahlmeier's picture
1 3

Daniel Dahlmeier

ddahlmeier

AI & ML interests

NLP

Recent Activity

updated a model 13 days ago
ddahlmeier/open_llama_3b_v2_chat_dolly
updated a model 15 days ago
ddahlmeier/llama-3.2-1B-sutdqa
published a model 15 days ago
ddahlmeier/llama-3.2-1B-sutdqa
View all activity

Organizations

None yet

ddahlmeier's activity

updated a model 13 days ago
updated a model 15 days ago
published a model 15 days ago
updated a model 15 days ago
published a model 15 days ago
updated a model 15 days ago
updated a dataset 15 days ago
updated a model 22 days ago
published a model 22 days ago
published a model about 1 month ago
updated a model about 1 month ago
published a model about 1 month ago
reacted to philschmid's post with 👍 7 months ago
view post
Post
What's the best way to fine-tune open LLMs in 2024? Look no further! 👀 I am excited to share “How to Fine-Tune LLMs in 2024 with Hugging Face” using the latest research techniques, including Flash Attention, Q-LoRA, OpenAI dataset formats (messages), ChatML, Packing, all built with Hugging Face TRL. 🚀

It is created for consumer-size GPUs (24GB) covering the full end-to-end lifecycle with:
💡Define and understand use cases for fine-tuning
🧑🏻‍💻 Setup of the development environment
🧮 Create and prepare dataset (OpenAI format)
🏋️‍♀️ Fine-tune LLM using TRL and the SFTTrainer
🥇 Test and evaluate the LLM
🚀 Deploy for production with TGI

👉  https://www.philschmid.de/fine-tune-llms-in-2024-with-trl

Coming soon: Advanced Guides for multi-GPU/multi-Node full fine-tuning and alignment using DPO & KTO. 🔜
·
upvoted a paper 7 months ago
upvoted a paper 8 months ago
updated a model 12 months ago
updated 2 models about 1 year ago
updated a dataset about 1 year ago