@erickrf That probably would have defied their initial intent of creating the most efficient BERT. A multilingual version has been trained from the base https://huggingface.co/answerdotai/ModernBERT-base/discussions/60, but it may not target your intended language.

Paul Desmond Parker
sunwukonga
AI & ML interests
None yet
Recent Activity
commented on
an
article
about 2 months ago
Finally, a Replacement for BERT: Introducing ModernBERT
Organizations
None yet
sunwukonga's activity

commented on
Finally, a Replacement for BERT: Introducing ModernBERT
about 2 months ago