Katochh commited on
Commit
cbe5188
1 Parent(s): 36bbda2

End of training

Browse files
README.md CHANGED
@@ -20,7 +20,7 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [petals-team/falcon-rw-1b](https://huggingface.co/petals-team/falcon-rw-1b) on the code_search_net dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 0.9946
24
 
25
  ## Model description
26
 
@@ -54,22 +54,22 @@ The following hyperparameters were used during training:
54
 
55
  | Training Loss | Epoch | Step | Validation Loss |
56
  |:-------------:|:-----:|:----:|:---------------:|
57
- | 1.2494 | 0.01 | 20 | 1.2566 |
58
- | 1.2362 | 0.02 | 40 | 1.1664 |
59
- | 1.3029 | 0.03 | 60 | 1.1197 |
60
- | 1.1248 | 0.04 | 80 | 1.0829 |
61
- | 1.2031 | 0.04 | 100 | 1.0871 |
62
- | 1.0559 | 0.05 | 120 | 1.0503 |
63
- | 1.1049 | 0.06 | 140 | 1.0452 |
64
- | 1.1459 | 0.07 | 160 | 1.0415 |
65
- | 1.0521 | 0.08 | 180 | 1.0262 |
66
- | 1.2023 | 0.09 | 200 | 1.0233 |
67
- | 0.9935 | 0.1 | 220 | 1.0112 |
68
- | 1.016 | 0.11 | 240 | 1.0035 |
69
- | 1.1182 | 0.12 | 260 | 0.9993 |
70
- | 1.0044 | 0.12 | 280 | 0.9957 |
71
- | 1.0908 | 0.13 | 300 | 0.9949 |
72
- | 0.9208 | 0.14 | 320 | 0.9946 |
73
 
74
 
75
  ### Framework versions
 
20
 
21
  This model is a fine-tuned version of [petals-team/falcon-rw-1b](https://huggingface.co/petals-team/falcon-rw-1b) on the code_search_net dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 1.0068
24
 
25
  ## Model description
26
 
 
54
 
55
  | Training Loss | Epoch | Step | Validation Loss |
56
  |:-------------:|:-----:|:----:|:---------------:|
57
+ | 1.231 | 0.01 | 20 | 1.2339 |
58
+ | 1.2932 | 0.02 | 40 | 1.1486 |
59
+ | 1.231 | 0.03 | 60 | 1.1240 |
60
+ | 1.0344 | 0.04 | 80 | 1.0872 |
61
+ | 1.3396 | 0.04 | 100 | 1.0973 |
62
+ | 0.9727 | 0.05 | 120 | 1.0608 |
63
+ | 1.1138 | 0.06 | 140 | 1.0520 |
64
+ | 1.1591 | 0.07 | 160 | 1.0442 |
65
+ | 0.9822 | 0.08 | 180 | 1.0286 |
66
+ | 1.1891 | 0.09 | 200 | 1.0345 |
67
+ | 1.0183 | 0.1 | 220 | 1.0194 |
68
+ | 1.0012 | 0.11 | 240 | 1.0142 |
69
+ | 1.1396 | 0.12 | 260 | 1.0116 |
70
+ | 1.0058 | 0.12 | 280 | 1.0074 |
71
+ | 1.1884 | 0.13 | 300 | 1.0072 |
72
+ | 0.9587 | 0.14 | 320 | 1.0068 |
73
 
74
 
75
  ### Framework versions
runs/Apr09_13-29-13_4ef27340d39a/events.out.tfevents.1712669380.4ef27340d39a.164.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:63dda1de2a29e8c37d5d727eda739591f66dae47faa3ed89db03f8b8ff375123
3
- size 13398
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83b95e1a7109229fd9ede4a3810a8a8945cc261df6ffdd5c3bc1d90f5e785023
3
+ size 13752