Omartificial-Intelligence-Space
commited on
Update readme.md
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ tags:
|
|
20 |
> [!NOTE]
|
21 |
> This is an Experimental Arabic Model demonstrates how ModernBERT can be adapted to Arabic for tasks like topic classification.
|
22 |
|
23 |
-
This is an Experimental Arabic version of [ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base),trained ONLY on Topic Classification Task using the base model of original modernbert with a custom Arabic trained tokenizer with the following details:
|
24 |
- **Dataset:** Arabic Wikipedia
|
25 |
- **Size:** 1.8 GB
|
26 |
- **Tokens:** 228,788,529 tokens
|
@@ -60,4 +60,18 @@ classifier(sample)
|
|
60 |
# [{'label': 'health', 'score': 0.6779336333274841}]
|
61 |
```
|
62 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
63 |
|
|
|
20 |
> [!NOTE]
|
21 |
> This is an Experimental Arabic Model demonstrates how ModernBERT can be adapted to Arabic for tasks like topic classification.
|
22 |
|
23 |
+
This is an Experimental **Arabic** version of [ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base), trained **ONLY on Topic Classification** Task using the base model of original modernbert with a custom Arabic trained tokenizer with the following details:
|
24 |
- **Dataset:** Arabic Wikipedia
|
25 |
- **Size:** 1.8 GB
|
26 |
- **Tokens:** 228,788,529 tokens
|
|
|
60 |
# [{'label': 'health', 'score': 0.6779336333274841}]
|
61 |
```
|
62 |
|
63 |
+
## Citation
|
64 |
+
|
65 |
+
```
|
66 |
+
@misc{modernbert,
|
67 |
+
title={Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference},
|
68 |
+
author={Benjamin Warner and Antoine Chaffin and Benjamin Clavié and Orion Weller and Oskar Hallström and Said Taghadouini and Alexis Gallagher and Raja Biswas and Faisal Ladhak and Tom Aarsen and Nathan Cooper and Griffin Adams and Jeremy Howard and Iacopo Poli},
|
69 |
+
year={2024},
|
70 |
+
eprint={2412.13663},
|
71 |
+
archivePrefix={arXiv},
|
72 |
+
primaryClass={cs.CL},
|
73 |
+
url={https://arxiv.org/abs/2412.13663},
|
74 |
+
}
|
75 |
+
```
|
76 |
+
|
77 |
|