Hugging Face's logo

oleshy
/
ontochem_biobert_v2

Token Classification
Transformers
Safetensors
bert
Generated from Trainer
Inference Endpoints
Model card Files Community
oleshy commited on
Commit
b4f0574
•
1 Parent(s): 8f8697e

Model save

Browse files
Files changed (2) hide show
  1. README.md +8 -12
  2. model.safetensors +1 -1
README.md CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [dmis-lab/biobert-base-cased-v1.1](https://huggingface.co/dmis-lab/biobert-base-cased-v1.1) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.0345
18
 
19
  ## Model description
20
 
@@ -40,22 +40,18 @@ The following hyperparameters were used during training:
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
42
  - lr_scheduler_warmup_steps: 500
43
- - num_epochs: 10
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | No log | 1.0 | 96 | 0.5601 |
50
- | No log | 2.0 | 192 | 0.0588 |
51
- | No log | 3.0 | 288 | 0.0361 |
52
- | No log | 4.0 | 384 | 0.0325 |
53
- | No log | 5.0 | 480 | 0.0297 |
54
- | 0.2391 | 6.0 | 576 | 0.0320 |
55
- | 0.2391 | 7.0 | 672 | 0.0322 |
56
- | 0.2391 | 8.0 | 768 | 0.0319 |
57
- | 0.2391 | 9.0 | 864 | 0.0338 |
58
- | 0.2391 | 10.0 | 960 | 0.0345 |
59
 
60
 
61
  ### Framework versions
 
14
 
15
  This model is a fine-tuned version of [dmis-lab/biobert-base-cased-v1.1](https://huggingface.co/dmis-lab/biobert-base-cased-v1.1) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.0312
18
 
19
  ## Model description
20
 
 
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
42
  - lr_scheduler_warmup_steps: 500
43
+ - num_epochs: 6
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | No log | 1.0 | 96 | 0.6038 |
50
+ | No log | 2.0 | 192 | 0.0551 |
51
+ | No log | 3.0 | 288 | 0.0369 |
52
+ | No log | 4.0 | 384 | 0.0338 |
53
+ | No log | 5.0 | 480 | 0.0307 |
54
+ | 0.2606 | 6.0 | 576 | 0.0312 |
 
 
 
 
55
 
56
 
57
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4d7e27a4077b4a5b6f31dfe32aff754aa892eb1d4acc65ee8173cacd00ff8276
3
  size 430911284
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5f1626977c3eff14601af6d78fc5077d82a468b3a3971c9f17f4d2152a2262e
3
  size 430911284