51 2 42

No Name

Ainonake

AI & ML interests

None yet

Recent Activity

liked a model 1 day ago

RekaAI/reka-flash-3

reacted to tomaarsen's post with ❤️ 4 days ago

An assembly of 18 European companies, labs, and universities have banded together to launch 🇪🇺 EuroBERT! It's a state-of-the-art multilingual encoder for 15 European languages, designed to be finetuned for retrieval, classification, etc. 🇪🇺 15 Languages: English, French, German, Spanish, Chinese, Italian, Russian, Polish, Portuguese, Japanese, Vietnamese, Dutch, Arabic, Turkish, Hindi 3️⃣ 3 model sizes: 210M, 610M, and 2.1B parameters - very very useful sizes in my opinion ➡️ Sequence length of 8192 tokens! Nice to see these higher sequence lengths for encoders becoming more common. ⚙️ Architecture based on Llama, but with bi-directional (non-causal) attention to turn it into an encoder. Flash Attention 2 is supported. 🔥 A new Pareto frontier (stronger *and* smaller) for multilingual encoder models 📊 Evaluated against mDeBERTa, mGTE, XLM-RoBERTa for Retrieval, Classification, and Regression (after finetuning for each task separately): EuroBERT punches way above its weight. 📝 Detailed paper with all details, incl. data: FineWeb for English and CulturaX for multilingual data, The Stack v2 and Proof-Pile-2 for code. Check out the release blogpost here: https://huggingface.co/blog/EuroBERT/release * https://huggingface.co/EuroBERT/EuroBERT-210m * https://huggingface.co/EuroBERT/EuroBERT-610m * https://huggingface.co/EuroBERT/EuroBERT-2.1B The next step is for researchers to build upon the 3 EuroBERT base models and publish strong retrieval, zero-shot classification, etc. models for all to use. I'm very much looking forward to it!

new activity 9 days ago

Undi95/MistralThinker-v1.1:This shit is fire

View all activity

Organizations

None yet

Ainonake's activity

liked a model 1 day ago

RekaAI/reka-flash-3

Updated 3 days ago • 2.18k • 257

liked a model 10 days ago

tencent/HunyuanVideo-I2V

Image-to-Video • Updated 3 days ago • 2.48k • 250

liked a model 18 days ago

Wan-AI/Wan2.1-T2V-1.3B

Text-to-Video • Updated 15 days ago • 23.6k • • 274

liked a model 19 days ago

yandex/YandexGPT-5-Lite-8B-pretrain

Updated 19 days ago • 9.31k • 167

liked 2 models about 1 month ago

agentica-org/DeepScaleR-1.5B-Preview

Text Generation • Updated 21 days ago • 77.7k • • 521

OnomaAIResearch/Illustrious-xl-early-release-v0

Text-to-Image • Updated Feb 13 • 91.4k • • 344

liked a dataset about 1 month ago

TheDrummer/ToxicQA-R1-v1

Viewer • Updated 12 days ago • 6.87k • 8 • 6

liked 3 models about 2 months ago

liked a dataset 2 months ago

Qwen/CodeElo

Viewer • Updated Jan 5 • 408 • 512 • 19

liked a dataset 3 months ago

unalignment/toxic-dpo-v0.2

Viewer • Updated Jan 9, 2024 • 541 • 106 • 124

liked 3 models 3 months ago

ai-sage/GigaChat-20B-A3B-instruct

Updated 20 days ago • 1.75k • 34

jukofyork/creative-writing-control-vectors-v3.0

Updated Sep 20, 2024 • 262k • 29

Sao10K/L3.3-70B-Euryale-v2.3

Text Generation • Updated Dec 8, 2024 • 1.32k • 62

liked a model 6 months ago

maywell/PiVoT-0.1-Evil-a

Text Generation • Updated Nov 26, 2023 • 1.83k • 44

liked 3 models 7 months ago

intervitens/mini-magnum-12b-v1.1

Text Generation • Updated Aug 7, 2024 • 896 • 77

anthracite-org/magnum-v2.5-12b-kto

Text Generation • Updated Aug 22, 2024 • 3.56k • 53

anthracite-org/magnum-v2-12b

Text Generation • Updated Sep 14, 2024 • 1.92k • 86

liked a model 8 months ago

NeverSleep/Lumimaid-v0.2-8B

Text Generation • Updated Jul 31, 2024 • 397 • 71