Update README.md
Browse files
README.md
CHANGED
@@ -1,4 +1,10 @@
|
|
1 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
2 |
|
3 |
The fine-tuning process was performed on a single P100 GPUs (16GB). The hyperparameters are:
|
4 |
|
@@ -23,6 +29,4 @@ although Bioformer was pretrained only on biomedical texts.
|
|
23 |
|
24 |
|
25 |
## Speed
|
26 |
-
In our experiments, the inference speed of Bioformer is 3x as fast as BERT-base/BioBERT/PubMedBERT, and is 40% faster than DistilBERT.
|
27 |
-
|
28 |
-
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
pipeline_tag: question-answering
|
6 |
+
---
|
7 |
+
[bioformer-8L](https://huggingface.co/bioformers/bioformer-8L) fined-tuned on the [SQuAD1](https://rajpurkar.github.io/SQuAD-explorer) dataset for 3 epochs.
|
8 |
|
9 |
The fine-tuning process was performed on a single P100 GPUs (16GB). The hyperparameters are:
|
10 |
|
|
|
29 |
|
30 |
|
31 |
## Speed
|
32 |
+
In our experiments, the inference speed of Bioformer is 3x as fast as BERT-base/BioBERT/PubMedBERT, and is 40% faster than DistilBERT.
|
|
|
|