46 54 172

Nick Doiron

monsoon-nlp

https://mapmeld.com/plant-based-llms/

AI & ML interests

biology and multilingual models

Recent Activity

upvoted an article 1 day ago

Welcome Llama 4 Maverick & Scout on Hugging Face!

upvoted a collection 1 day ago

Llama 4

reacted to merterbak's post with 🔥 1 day ago

Meta has unveiled its Llama 4 🦙 family of models, featuring native multimodality and mixture-of-experts architecture. Two model families are available now: Models🤗: https://huggingface.co/collections/meta-llama/llama-4-67f0c30d9fe03840bc9d0164 Blog Post: https://ai.meta.com/blog/llama-4-multimodal-intelligence/ HF's Blog Post: https://huggingface.co/blog/llama4-release - 🧠 Native Multimodality - Process text and images in a unified architecture - 🔍 Mixture-of-Experts - First Llama models using MoE for incredible efficiency - 📏 Super Long Context - Up to 10M tokens - 🌐 Multilingual Power - Trained on 200 languages with 10x more multilingual tokens than Llama 3 (including over 100 languages with over 1 billion tokens each) 🔹 Llama 4 Scout - 17B active parameters (109B total) - 16 experts architecture - 10M context window - Fits on a single H100 GPU - Beats Gemma 3, Gemini 2.0 Flash-Lite, and Mistral 3.1 🔹 Llama 4 Maverick - 17B active parameters (400B total) - 128 experts architecture - It can fit perfectly on DGX H100(8x H100) - 1M context window - Outperforms GPT-4o and Gemini 2.0 Flash - ELO score of 1417 on LMArena currently second best model on arena 🔹 Llama 4 Behemoth (Coming Soon) - 288B active parameters (2T total) - 16 experts architecture - Teacher model for Scout and Maverick - Outperforms GPT-4.5, Claude Sonnet 3.7, and Gemini 2.0 Pro on STEM benchmarks

View all activity

Organizations

monsoon-nlp's activity

New activity in DataoceanAI/dolphin-base 5 days ago

add language tags

#3 opened 5 days ago by

monsoon-nlp

New activity in monsoon-nlp/redcode-hf 23 days ago

[bot] Conversion to Parquet

#1 opened 3 months ago by

parquet-converter

New activity in monsoon-nlp/gpt-nyc-nontoxic 28 days ago

Adding `safetensors` variant of this model

#1 opened about 1 month ago by

SFconvertbot

New activity in monsoon-nlp/dv-muril 28 days ago

Adding `safetensors` variant of this model

#1 opened about 1 month ago by

SFconvertbot

New activity in monsoon-nlp/dv-labse 28 days ago

Adding `safetensors` variant of this model

#1 opened about 1 month ago by

SFconvertbot

New activity in monsoon-nlp/genetic-counselor-multiple-choice 28 days ago

[bot] Conversion to Parquet

#1 opened 28 days ago by

parquet-converter

New activity in monsoon-nlp/genetic-counselor-freeform-questions 29 days ago

[bot] Conversion to Parquet

#1 opened 29 days ago by

parquet-converter

New activity in monsoon-nlp/byt5-basque about 1 month ago

Adding `safetensors` variant of this model

#1 opened about 2 months ago by

SFconvertbot

New activity in monsoon-nlp/byt5-dv about 1 month ago

Adding `safetensors` variant of this model

#1 opened about 2 months ago by

SFconvertbot

New activity in monsoon-nlp/dv-wave 2 months ago

Adding `safetensors` variant of this model

#1 opened 2 months ago by

SFconvertbot

New activity in monsoon-nlp/byt5-base-dv 3 months ago

Adding `safetensors` variant of this model

#1 opened 3 months ago by

SFconvertbot

commented a paper 3 months ago

Titans: Learning to Memorize at Test Time

Paper • 2501.00663 • Published Dec 31, 2024 • 22 •

New activity in metagene-ai/HumanVirusInfecting 3 months ago

Is this Pathogen-Detect from the paper?

#2 opened 3 months ago by

monsoon-nlp

New activity in monsoon-nlp/bangla-electra 4 months ago

Adding `safetensors` variant of this model

#1 opened 4 months ago by

SFconvertbot

New activity in monsoon-nlp/code-refusal-for-abliteration 5 months ago

Integrate m/re spurces

#1 opened 5 months ago by

monsoon-nlp

commented 2 papers 5 months ago

RedCode: Risky Code Execution and Generation Benchmark for Code Agents

Paper • 2411.07781 • Published Nov 12, 2024 • 1 •

MrT5: Dynamic Token Merging for Efficient Byte-level Language Models

Paper • 2410.20771 • Published Oct 28, 2024 • 3 •

New activity in wentingzhao/WildHallucinations 5 months ago

Arxiv link to WildHallucinations instead of WildChat (maybe have both)

#3 opened 7 months ago by

monsoon-nlp

New activity in EvolutionaryScale/esm3-sm-open-v1 9 months ago

Error - Checkout your internet connection

#2 opened 9 months ago by

vladak

New activity in togethercomputer/evo-1-131k-base 10 months ago

issue loading the model

#1 opened 12 months ago by

adrienchaton