Psi and Ilu

community

Activity Feed Request to join this org

AI & ML interests

None defined yet.

Recent Activity

ilu000 authored a paper 11 months ago

H2O-Danube-1.8B Technical Report

psinger authored a paper 11 months ago

H2O-Danube-1.8B Technical Report

ilu000 authored a paper about 1 year ago

H2O Open Ecosystem for State-of-the-art Large Language Models

View all activity

psiilu's activity

psinger

posted an update 9 months ago

Post

2086

Releasing H2O-Danube2-1.8b - a new and improved language model being the current top model on the Open LLM Leaderboard.

The model is trained on additional 2T tokens (total of 3T tokens) with various data mix stages as a result of extensive experimentation. Focus is on natural language tasks.

Base weights: h2oai/h2o-danube2-1.8b-base
SFT weights: h2oai/h2o-danube2-1.8b-sft
Chat weights: h2oai/h2o-danube2-1.8b-chat

ilu000

updated a model 9 months ago

psiilu/h2o-dpo-merge2

Text Generation • Updated Apr 5 • 21

psinger

posted an update 11 months ago

Post

Happy to share H2O-Danube-1.8b, a small 1.8b model based trained on only 1T natural language tokens showing competitive metrics across benchmarks in the <2B model space.

Base weights: h2oai/h2o-danube-1.8b-base
Chat weights: h2oai/h2o-danube-1.8b-chat
Technical report: H2O-Danube-1.8B Technical Report (2401.16818)