File size: 1,281 Bytes
64eaac6
 
 
 
 
 
 
 
 
 
 
 
 
 
908e5e8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
64eaac6
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
---
title: Marketplace Products
emoji: 🚀
colorFrom: purple
colorTo: yellow
sdk: gradio
sdk_version: 4.37.2
app_file: app.py
pinned: false
license: apache-2.0
---

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference

# This model is a fine-tuned version of distilbert/distilbert-base-uncased for NER Task. 

### The following hyperparameters were used during training:

- learning_rate=2e-5,
- per_device_train_batch_size=128,
- per_device_eval_batch_size=128,
- num_train_epochs=4,
- weight_decay=0.01,
- num_epochs: 4

### It achieves the following results on the evaluation set:

#### Training results

| Epoch | Training Loss | Validation Loss | Precision |  Recall  |    F1    | Accuracy |
|:-----:|:-------------:|:---------------:|:---------:|:--------:|:--------:|:--------:|
|   1   |    0.286800   |     0.125389    |  0.977472 | 0.977472 | 0.977472 | 0.977472 |
|   2   |    0.051800   |     0.026039    |  0.993742 | 0.993742 | 0.993742 | 0.993742 |
|   3   |    0.024200   |     0.013263    |  0.994994 | 0.994994 | 0.994994 | 0.994994 |
|   4   |    0.015500   |     0.013252    |  0.994994 | 0.994994 | 0.994994 | 0.994994 |


Framework versions
Transformers 4.41.2
Pytorch 2.3.0+cu121
Datasets 2.19.2
Tokenizers 0.19.1