Deriving DPO's Loss
•
15
Haitham Bou Ammar PRO
hba123
AI & ML interests
LLMs, VLMs, Robotics, Reinforcement Learning, Bayesian Optimisation
Recent Activity
reacted
to
their
post
with 🚀
1 day ago
Blindly applying algorithms without understanding the math behind them is not a good idea frmpv. So, I am on a quest to fix this!
I wrote my first hugging face article on how you would derive closed-form solutions for KL-regularised reinforcement learning problems - what is used for DPO.
Check it out: https://huggingface.co/blog/hba123/derivingdpo
posted
an
update
1 day ago
Blindly applying algorithms without understanding the math behind them is not a good idea frmpv. So, I am on a quest to fix this!
I wrote my first hugging face article on how you would derive closed-form solutions for KL-regularised reinforcement learning problems - what is used for DPO.
Check it out: https://huggingface.co/blog/hba123/derivingdpo
commented
a paper
1 day ago
ROS-LLM: A ROS framework for embodied AI with task feedback and
structured reasoning
Articles
Organizations
None yet
hba123's activity
commented
a
paper
1 day ago
commented
a
paper
19 days ago
commented
a
paper
about 2 months ago
commented
a
paper
4 months ago
commented
a
paper
5 months ago
commented
2
papers
6 months ago