FredZhang7
commited on
Commit
•
11f1de9
1
Parent(s):
2beddd4
update to v3
Browse files
README.md
CHANGED
@@ -68,16 +68,16 @@ Find the v1 (TensorFlow) model on [this page](https://github.com/FredZhang7/tfjs
|
|
68 |
|
69 |
<br>
|
70 |
|
71 |
-
| |
|
72 |
|----------|----------|----------|
|
73 |
| Base Model | bert-base-multilingual-cased | nlpaueb/legal-bert-small-uncased |
|
74 |
| Base Tokenizer | bert-base-multilingual-cased | bert-base-multilingual-cased |
|
75 |
| Framework | PyTorch | TensorFlow |
|
76 |
-
| Dataset Size |
|
77 |
| Train Split | 80% English<br>20% English + 100% Multilingual | None |
|
78 |
| English Train Accuracy | 99.4% | N/A (≈97.5%) |
|
79 |
-
| Other Train Accuracy | 96.
|
80 |
-
| Final Val Accuracy | 95.
|
81 |
| Languages | 55 | N/A (≈35) |
|
82 |
| Hyperparameters | maxlen=208<br>padding='max_length'<br>batch_size=112<br>optimizer=Adam<br>learning_rate=1e-5<br>loss=BCEWithLogitsLoss() | maxlen=192<br>padding='max_length'<br>batch_size=16<br>optimizer=Adam<br>learning_rate=1e-5<br>loss="binary_crossentropy" |
|
83 |
| Training Stopped | 6/30/2023 | 9/05/2022 |
|
|
|
68 |
|
69 |
<br>
|
70 |
|
71 |
+
| | v3 | v1 |
|
72 |
|----------|----------|----------|
|
73 |
| Base Model | bert-base-multilingual-cased | nlpaueb/legal-bert-small-uncased |
|
74 |
| Base Tokenizer | bert-base-multilingual-cased | bert-base-multilingual-cased |
|
75 |
| Framework | PyTorch | TensorFlow |
|
76 |
+
| Dataset Size | 3.0M | 2.68M |
|
77 |
| Train Split | 80% English<br>20% English + 100% Multilingual | None |
|
78 |
| English Train Accuracy | 99.4% | N/A (≈97.5%) |
|
79 |
+
| Other Train Accuracy | 96.7% | 96.6% |
|
80 |
+
| Final Val Accuracy | 95.2% | 94.6% |
|
81 |
| Languages | 55 | N/A (≈35) |
|
82 |
| Hyperparameters | maxlen=208<br>padding='max_length'<br>batch_size=112<br>optimizer=Adam<br>learning_rate=1e-5<br>loss=BCEWithLogitsLoss() | maxlen=192<br>padding='max_length'<br>batch_size=16<br>optimizer=Adam<br>learning_rate=1e-5<br>loss="binary_crossentropy" |
|
83 |
| Training Stopped | 6/30/2023 | 9/05/2022 |
|