update readme
Browse files
README.md
CHANGED
|
@@ -3,7 +3,11 @@
|
|
| 3 |
**Work in progress**
|
| 4 |
|
| 5 |
## Introduction
|
| 6 |
-
SciBERT-based model pre-trained with materials science scientific
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
|
| 8 |
## TLDR
|
| 9 |
- Collected full-text from ~700000 articles provided by the National Institute for Materials Science (NIMS) TDM platform (https://dice.nims.go.jp/services/TDM-PF/en/), dataset called ScienceCorpus (SciCorpus)
|
|
@@ -16,13 +20,11 @@ SciBERT-based model pre-trained with materials science scientific fulltexts
|
|
| 16 |
|
| 17 |
## Related work
|
| 18 |
|
| 19 |
-
### BERT Implementations
|
| 20 |
-
-
|
| 21 |
- BERT (the original) https://arxiv.org/abs/1810.04805
|
| 22 |
- RoBERTa (Re-implementation by Facebook) https://arxiv.org/abs/1907.11692
|
| 23 |
|
| 24 |
### Relevant models
|
| 25 |
-
|
| 26 |
- SciBERT: BERT, from scratch, scientific articles (biology + CS) https://github.com/allenai/scibert
|
| 27 |
- MatSciBERT (Gupta): RoBERTa, from scratch, SciBERT vocab and weights, ~150 K paper limited to 4 MS families http://github.com/m3rg-iitd/matscibert
|
| 28 |
- MaterialBERT: Not yet published
|
|
|
|
| 3 |
**Work in progress**
|
| 4 |
|
| 5 |
## Introduction
|
| 6 |
+
SciBERT-based model pre-trained with materials science scientific fulltext
|
| 7 |
+
|
| 8 |
+
## Authors
|
| 9 |
+
Luca Foppiano
|
| 10 |
+
Pedro Ortiz Suarez
|
| 11 |
|
| 12 |
## TLDR
|
| 13 |
- Collected full-text from ~700000 articles provided by the National Institute for Materials Science (NIMS) TDM platform (https://dice.nims.go.jp/services/TDM-PF/en/), dataset called ScienceCorpus (SciCorpus)
|
|
|
|
| 20 |
|
| 21 |
## Related work
|
| 22 |
|
| 23 |
+
### BERT Implementations
|
|
|
|
| 24 |
- BERT (the original) https://arxiv.org/abs/1810.04805
|
| 25 |
- RoBERTa (Re-implementation by Facebook) https://arxiv.org/abs/1907.11692
|
| 26 |
|
| 27 |
### Relevant models
|
|
|
|
| 28 |
- SciBERT: BERT, from scratch, scientific articles (biology + CS) https://github.com/allenai/scibert
|
| 29 |
- MatSciBERT (Gupta): RoBERTa, from scratch, SciBERT vocab and weights, ~150 K paper limited to 4 MS families http://github.com/m3rg-iitd/matscibert
|
| 30 |
- MaterialBERT: Not yet published
|