l3cube-pune's picture
Update README.md
d73a525
|
raw
history blame
2.28 kB
metadata
language:
  - hi
  - mr
  - multilingual
license: cc-by-4.0

DevBERT

DevBERT is a Devanagari BERT model. It is a multilingual BERT (google/muril-base-cased) model fine-tuned on publicly available Hindi and Marathi monolingual datasets. [project link] (https://github.com/l3cube-pune/MarathiNLP)

More details on the dataset, models, and baseline results can be found in our [ paper ] .

Citing:

@article{joshi2022l3cubehind,
  title={L3Cube-HindBERT and DevBERT: Pre-Trained BERT Transformer models for Devanagari based Hindi and Marathi Languages},
  author={Joshi, Raviraj},
  journal={arXiv preprint arXiv:2211.11418},
  year={2022}
}

Other Monolingual Indic BERT models are listed below:
Marathi BERT
Marathi RoBERTa
Marathi AlBERT

Hindi BERT
Hindi RoBERTa
Hindi AlBERT

Dev BERT
Dev RoBERTa
Dev AlBERT

Kannada BERT
Telugu BERT
Malayalam BERT
Tamil BERT
Gujarati BERT
Oriya BERT
Bengali BERT
Punjabi BERT
Assamese BERT