LightYagamigg commited on
Commit
1f57d0c
·
1 Parent(s): e0fc139

End of training

Browse files
Files changed (4) hide show
  1. README.md +13 -0
  2. adapter_model.bin +1 -1
  3. tokenizer.json +6 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -5,6 +5,7 @@ tags:
5
  model-index:
6
  - name: results
7
  results: []
 
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -28,6 +29,17 @@ More information needed
28
 
29
  ## Training procedure
30
 
 
 
 
 
 
 
 
 
 
 
 
31
  ### Training hyperparameters
32
 
33
  The following hyperparameters were used during training:
@@ -45,6 +57,7 @@ The following hyperparameters were used during training:
45
 
46
  ### Framework versions
47
 
 
48
  - Transformers 4.31.0
49
  - Pytorch 2.3.1+cu121
50
  - Datasets 2.20.0
 
5
  model-index:
6
  - name: results
7
  results: []
8
+ library_name: peft
9
  ---
10
 
11
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
29
 
30
  ## Training procedure
31
 
32
+
33
+ The following `bitsandbytes` quantization config was used during training:
34
+ - load_in_8bit: False
35
+ - load_in_4bit: True
36
+ - llm_int8_threshold: 6.0
37
+ - llm_int8_skip_modules: None
38
+ - llm_int8_enable_fp32_cpu_offload: False
39
+ - llm_int8_has_fp16_weight: False
40
+ - bnb_4bit_quant_type: nf4
41
+ - bnb_4bit_use_double_quant: False
42
+ - bnb_4bit_compute_dtype: float16
43
  ### Training hyperparameters
44
 
45
  The following hyperparameters were used during training:
 
57
 
58
  ### Framework versions
59
 
60
+ - PEFT 0.4.0
61
  - Transformers 4.31.0
62
  - Pytorch 2.3.1+cu121
63
  - Datasets 2.20.0
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:89b2286691598d31e948e6da4f62ac5537d1aea271e20f1fe0b06388381fa569
3
  size 134264202
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08f978564a319087e1567a609cd1ae5da38288d1ff71ffc9b93ff153310beac7
3
  size 134264202
tokenizer.json CHANGED
@@ -1,6 +1,11 @@
1
  {
2
  "version": "1.0",
3
- "truncation": null,
 
 
 
 
 
4
  "padding": null,
5
  "added_tokens": [
6
  {
 
1
  {
2
  "version": "1.0",
3
+ "truncation": {
4
+ "direction": "Right",
5
+ "max_length": 1024,
6
+ "strategy": "LongestFirst",
7
+ "stride": 0
8
+ },
9
  "padding": null,
10
  "added_tokens": [
11
  {
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b489ab9a23700d00bedcd3e74aa40c2043d8a77269c5321b81c1d483e87c1b57
3
  size 4408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c0e1b33cacbc6c33064113702fb9a4d3397cdfd992c4d24c036d7856a0e3f90
3
  size 4408