deepaksiloka
commited on
Model save
Browse files- README.md +126 -0
- model.safetensors +1 -1
README.md
ADDED
@@ -0,0 +1,126 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
library_name: transformers
|
3 |
+
license: apache-2.0
|
4 |
+
base_model: distilbert-base-uncased
|
5 |
+
tags:
|
6 |
+
- generated_from_trainer
|
7 |
+
model-index:
|
8 |
+
- name: PII-Detection
|
9 |
+
results: []
|
10 |
+
---
|
11 |
+
|
12 |
+
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
13 |
+
should probably proofread and complete it, then remove this comment. -->
|
14 |
+
|
15 |
+
# PII-Detection
|
16 |
+
|
17 |
+
This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
|
18 |
+
It achieves the following results on the evaluation set:
|
19 |
+
- Loss: 0.0643
|
20 |
+
- Overall Precision: 0.9370
|
21 |
+
- Overall Recall: 0.9502
|
22 |
+
- Overall F1: 0.9436
|
23 |
+
- Overall Accuracy: 0.9823
|
24 |
+
- Accountname F1: 0.9835
|
25 |
+
- Accountnumber F1: 0.9792
|
26 |
+
- Amount F1: 0.9439
|
27 |
+
- Bic F1: 0.8741
|
28 |
+
- Bitcoinaddress F1: 0.9478
|
29 |
+
- Buildingnumber F1: 0.6465
|
30 |
+
- City F1: 0.9865
|
31 |
+
- Company Name F1: 0.9583
|
32 |
+
- County F1: 0.9811
|
33 |
+
- Creditcardcvv F1: 0.9007
|
34 |
+
- Creditcardissuer F1: 0.9302
|
35 |
+
- Creditcardnumber F1: 0.8662
|
36 |
+
- Currency F1: 0.7101
|
37 |
+
- Currencycode F1: 0.7445
|
38 |
+
- Currencyname F1: 0.4375
|
39 |
+
- Currencysymbol F1: 0.5600
|
40 |
+
- Date F1: 0.9873
|
41 |
+
- Displayname F1: 0.4706
|
42 |
+
- Email F1: 0.9991
|
43 |
+
- Ethereumaddress F1: 0.9808
|
44 |
+
- Firstname F1: 0.8912
|
45 |
+
- Fullname F1: 0.9867
|
46 |
+
- Gender F1: 0.8462
|
47 |
+
- Iban F1: 0.9947
|
48 |
+
- Ip F1: 0.2642
|
49 |
+
- Ipv4 F1: 0.8165
|
50 |
+
- Ipv6 F1: 0.6330
|
51 |
+
- Jobarea F1: 0.9734
|
52 |
+
- Jobdescriptor F1: 0.8723
|
53 |
+
- Jobtitle F1: 0.9760
|
54 |
+
- Jobtype F1: 0.9150
|
55 |
+
- Lastname F1: 0.7589
|
56 |
+
- Litecoinaddress F1: 0.9123
|
57 |
+
- Mac F1: 1.0
|
58 |
+
- Maskednumber F1: 0.8000
|
59 |
+
- Middlename F1: 0.8033
|
60 |
+
- Name F1: 0.9966
|
61 |
+
- Nearbygpscoordinate F1: 1.0
|
62 |
+
- Number F1: 0.9159
|
63 |
+
- Ordinaldirection F1: 0.0
|
64 |
+
- Password F1: 0.9497
|
65 |
+
- Phoneimei F1: 0.9756
|
66 |
+
- Phone Number F1: 0.9244
|
67 |
+
- Pin F1: 0.8889
|
68 |
+
- Prefix F1: 0.9009
|
69 |
+
- Secondaryaddress F1: 0.9939
|
70 |
+
- Sex F1: 0.9032
|
71 |
+
- Sextype F1: 0.0
|
72 |
+
- Ssn F1: 0.8992
|
73 |
+
- State F1: 0.9931
|
74 |
+
- Street F1: 0.6906
|
75 |
+
- Streetaddress F1: 0.8523
|
76 |
+
- Suffix F1: 0.9026
|
77 |
+
- Time F1: 0.9796
|
78 |
+
- Url F1: 0.9973
|
79 |
+
- Useragent F1: 0.9839
|
80 |
+
- Username F1: 0.8900
|
81 |
+
- Vehiclevin F1: 0.9612
|
82 |
+
- Vehiclevrm F1: 0.9697
|
83 |
+
- Zipcode F1: 0.9387
|
84 |
+
|
85 |
+
## Model description
|
86 |
+
|
87 |
+
More information needed
|
88 |
+
|
89 |
+
## Intended uses & limitations
|
90 |
+
|
91 |
+
More information needed
|
92 |
+
|
93 |
+
## Training and evaluation data
|
94 |
+
|
95 |
+
More information needed
|
96 |
+
|
97 |
+
## Training procedure
|
98 |
+
|
99 |
+
### Training hyperparameters
|
100 |
+
|
101 |
+
The following hyperparameters were used during training:
|
102 |
+
- learning_rate: 5e-05
|
103 |
+
- train_batch_size: 32
|
104 |
+
- eval_batch_size: 32
|
105 |
+
- seed: 42
|
106 |
+
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
107 |
+
- lr_scheduler_type: linear
|
108 |
+
- num_epochs: 5
|
109 |
+
|
110 |
+
### Training results
|
111 |
+
|
112 |
+
| Training Loss | Epoch | Step | Validation Loss | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy | Accountname F1 | Accountnumber F1 | Amount F1 | Bic F1 | Bitcoinaddress F1 | Buildingnumber F1 | City F1 | Company Name F1 | County F1 | Creditcardcvv F1 | Creditcardissuer F1 | Creditcardnumber F1 | Currency F1 | Currencycode F1 | Currencyname F1 | Currencysymbol F1 | Date F1 | Displayname F1 | Email F1 | Ethereumaddress F1 | Firstname F1 | Fullname F1 | Gender F1 | Iban F1 | Ip F1 | Ipv4 F1 | Ipv6 F1 | Jobarea F1 | Jobdescriptor F1 | Jobtitle F1 | Jobtype F1 | Lastname F1 | Litecoinaddress F1 | Mac F1 | Maskednumber F1 | Middlename F1 | Name F1 | Nearbygpscoordinate F1 | Number F1 | Ordinaldirection F1 | Password F1 | Phoneimei F1 | Phone Number F1 | Pin F1 | Prefix F1 | Secondaryaddress F1 | Sex F1 | Sextype F1 | Ssn F1 | State F1 | Street F1 | Streetaddress F1 | Suffix F1 | Time F1 | Url F1 | Useragent F1 | Username F1 | Vehiclevin F1 | Vehiclevrm F1 | Zipcode F1 |
|
113 |
+
|:-------------:|:-----:|:----:|:---------------:|:-----------------:|:--------------:|:----------:|:----------------:|:--------------:|:----------------:|:---------:|:------:|:-----------------:|:-----------------:|:-------:|:---------------:|:---------:|:----------------:|:-------------------:|:-------------------:|:-----------:|:---------------:|:---------------:|:-----------------:|:-------:|:--------------:|:--------:|:------------------:|:------------:|:-----------:|:---------:|:-------:|:------:|:-------:|:-------:|:----------:|:----------------:|:-----------:|:----------:|:-----------:|:------------------:|:------:|:---------------:|:-------------:|:-------:|:----------------------:|:---------:|:-------------------:|:-----------:|:------------:|:---------------:|:------:|:---------:|:-------------------:|:------:|:----------:|:------:|:--------:|:---------:|:----------------:|:---------:|:-------:|:------:|:------------:|:-----------:|:-------------:|:-------------:|:----------:|
|
114 |
+
| 0.1445 | 1.0 | 1337 | 0.0873 | 0.8766 | 0.9038 | 0.8900 | 0.9710 | 0.9132 | 0.9245 | 0.8316 | 0.6260 | 0.7211 | 0.5392 | 0.9670 | 0.8041 | 0.9658 | 0.6462 | 0.7333 | 0.6833 | 0.5885 | 0.4341 | 0.016 | 0.0513 | 0.9726 | 0.0 | 0.9986 | 0.8778 | 0.7974 | 0.9812 | 0.5905 | 0.8744 | 0.0405 | 0.7125 | 0.7616 | 0.9148 | 0.0 | 0.7961 | 0.5644 | 0.5821 | 0.6442 | 0.9573 | 0.2375 | 0.1486 | 0.9865 | 0.3077 | 0.7009 | 0.0 | 0.8883 | 0.9697 | 0.7985 | 0.6387 | 0.8256 | 0.8772 | 0.8742 | 0.0 | 0.8593 | 0.9870 | 0.5492 | 0.8496 | 0.4966 | 0.9632 | 0.9754 | 0.9370 | 0.8839 | 0.8857 | 0.8 | 0.8691 |
|
115 |
+
| 0.0599 | 2.0 | 2674 | 0.0573 | 0.9218 | 0.9369 | 0.9293 | 0.9786 | 0.9669 | 0.9679 | 0.9179 | 0.8429 | 0.78 | 0.4982 | 0.9831 | 0.9375 | 0.9774 | 0.8873 | 0.9153 | 0.8418 | 0.7326 | 0.6621 | 0.1102 | 0.5634 | 0.975 | 0.0 | 0.9972 | 0.9202 | 0.8603 | 0.9859 | 0.7925 | 0.9684 | 0.1164 | 0.7847 | 0.7129 | 0.9626 | 0.6752 | 0.9445 | 0.8734 | 0.6809 | 0.6931 | 0.9811 | 0.7468 | 0.6905 | 0.9943 | 1.0 | 0.8165 | 0.0 | 0.9385 | 0.9756 | 0.8465 | 0.8190 | 0.8899 | 0.9878 | 0.8861 | 0.0 | 0.8769 | 0.9905 | 0.6496 | 0.8784 | 0.8513 | 0.9662 | 0.9932 | 0.9490 | 0.9149 | 0.9394 | 0.9265 | 0.8732 |
|
116 |
+
| 0.0411 | 3.0 | 4011 | 0.0517 | 0.9146 | 0.9444 | 0.9292 | 0.9804 | 0.9703 | 0.9837 | 0.9269 | 0.8939 | 0.8806 | 0.615 | 0.9837 | 0.9220 | 0.9811 | 0.8742 | 0.9249 | 0.8497 | 0.6351 | 0.6970 | 0.4037 | 0.5195 | 0.9824 | 0.3956 | 0.9989 | 0.9761 | 0.8779 | 0.9851 | 0.8081 | 0.9894 | 0.1043 | 0.8622 | 0.5398 | 0.9655 | 0.8333 | 0.9742 | 0.92 | 0.7368 | 0.8432 | 0.9905 | 0.7389 | 0.7661 | 0.9947 | 1.0 | 0.8505 | 0.0 | 0.9435 | 1.0 | 0.9204 | 0.8491 | 0.8920 | 0.9878 | 0.8889 | 0.0 | 0.9538 | 0.9896 | 0.6269 | 0.7057 | 0.8900 | 0.9796 | 0.9945 | 0.9641 | 0.8623 | 0.9606 | 0.9143 | 0.9672 |
|
117 |
+
| 0.0226 | 4.0 | 5348 | 0.0599 | 0.9349 | 0.9482 | 0.9415 | 0.9824 | 0.9835 | 0.9746 | 0.9041 | 0.8939 | 0.8963 | 0.6707 | 0.9871 | 0.9141 | 0.9848 | 0.8707 | 0.9302 | 0.8702 | 0.6916 | 0.6618 | 0.3830 | 0.5195 | 0.9848 | 0.4651 | 0.9986 | 0.9581 | 0.8872 | 0.9862 | 0.8776 | 0.9892 | 0.2561 | 0.8682 | 0.7172 | 0.9726 | 0.8763 | 0.9814 | 0.9322 | 0.7266 | 0.7826 | 0.9952 | 0.8193 | 0.7256 | 0.9960 | 1.0 | 0.9014 | 0.0 | 0.9494 | 0.9816 | 0.9238 | 0.8462 | 0.9002 | 0.9939 | 0.8987 | 0.0 | 0.9091 | 0.9922 | 0.6997 | 0.8472 | 0.8821 | 0.9796 | 0.9973 | 0.9758 | 0.8940 | 0.9538 | 0.9624 | 0.9485 |
|
118 |
+
| 0.0129 | 5.0 | 6685 | 0.0643 | 0.9370 | 0.9502 | 0.9436 | 0.9823 | 0.9835 | 0.9792 | 0.9439 | 0.8741 | 0.9478 | 0.6465 | 0.9865 | 0.9583 | 0.9811 | 0.9007 | 0.9302 | 0.8662 | 0.7101 | 0.7445 | 0.4375 | 0.5600 | 0.9873 | 0.4706 | 0.9991 | 0.9808 | 0.8912 | 0.9867 | 0.8462 | 0.9947 | 0.2642 | 0.8165 | 0.6330 | 0.9734 | 0.8723 | 0.9760 | 0.9150 | 0.7589 | 0.9123 | 1.0 | 0.8000 | 0.8033 | 0.9966 | 1.0 | 0.9159 | 0.0 | 0.9497 | 0.9756 | 0.9244 | 0.8889 | 0.9009 | 0.9939 | 0.9032 | 0.0 | 0.8992 | 0.9931 | 0.6906 | 0.8523 | 0.9026 | 0.9796 | 0.9973 | 0.9839 | 0.8900 | 0.9612 | 0.9697 | 0.9387 |
|
119 |
+
|
120 |
+
|
121 |
+
### Framework versions
|
122 |
+
|
123 |
+
- Transformers 4.44.2
|
124 |
+
- Pytorch 2.4.1+cu121
|
125 |
+
- Datasets 3.0.1
|
126 |
+
- Tokenizers 0.19.1
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 265820688
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:39505a959519b9ed098e639adb309fdf176e54612173d98ef4ea54dc90df1cc2
|
3 |
size 265820688
|