Llama 2: Open Foundation and Fine-Tuned Chat Models
Paper
•
2307.09288
•
Published
•
243
•
20
ramkrish
ramkrish120595
AI & ML interests
None yet
Recent Activity
reacted
to
philschmid's
post
with ❤️
about 2 months ago
What's the best way to fine-tune open LLMs in 2024? Look no further! 👀 I am excited to share “How to Fine-Tune LLMs in 2024 with Hugging Face” using the latest research techniques, including Flash Attention, Q-LoRA, OpenAI dataset formats (messages), ChatML, Packing, all built with Hugging Face TRL. 🚀
It is created for consumer-size GPUs (24GB) covering the full end-to-end lifecycle with:
💡Define and understand use cases for fine-tuning
🧑🏻💻 Setup of the development environment
🧮 Create and prepare dataset (OpenAI format)
🏋️♀️ Fine-tune LLM using TRL and the SFTTrainer
🥇 Test and evaluate the LLM
🚀 Deploy for production with TGI
👉 https://www.philschmid.de/fine-tune-llms-in-2024-with-trl
Coming soon: Advanced Guides for multi-GPU/multi-Node full fine-tuning and alignment using DPO & KTO. 🔜
Organizations
None yet
ramkrish120595's activity
How to finetune Phi2 using RoPE and QLoRA for long text summary generation?
4
#102 opened 11 months ago
by
parikshit1619
commented
a
paper
over 1 year ago
Fine-tune the model?
82
#46 opened over 2 years ago
by
NXBY
Fine-tune the model?
82
#46 opened over 2 years ago
by
NXBY