Hugging Face's logo

Weni
/
ZeroShot-Multilanguage-Zephyr-7B

PEFT
PyTorch
English
Portuguese
mistral
Model card Files Community
2
Mel-Iza0 commited on
Commit
32662c3
·
1 Parent(s): a527441

Training in progress, epoch 2, checkpoint

Browse files
Files changed (6) hide show
  1. checkpoint-1838/README.md +26 -0
  2. checkpoint-1838/adapter_model.bin +1 -1
  3. checkpoint-1838/optimizer.pt +1 -1
  4. checkpoint-1838/scheduler.pt +1 -1
  5. checkpoint-1838/trainer_state.json +0 -0
  6. checkpoint-1838/training_args.bin +1 -1
checkpoint-1838/README.md CHANGED
@@ -4,6 +4,30 @@ library_name: peft
4
  ## Training procedure
5
 
6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  The following `bitsandbytes` quantization config was used during training:
8
  - quant_method: bitsandbytes
9
  - load_in_8bit: False
@@ -29,6 +53,8 @@ The following `bitsandbytes` quantization config was used during training:
29
  - bnb_4bit_compute_dtype: bfloat16
30
  ### Framework versions
31
 
 
 
32
  - PEFT 0.4.0
33
 
34
  - PEFT 0.4.0
 
4
  ## Training procedure
5
 
6
 
7
+ The following `bitsandbytes` quantization config was used during training:
8
+ - quant_method: bitsandbytes
9
+ - load_in_8bit: False
10
+ - load_in_4bit: True
11
+ - llm_int8_threshold: 6.0
12
+ - llm_int8_skip_modules: None
13
+ - llm_int8_enable_fp32_cpu_offload: False
14
+ - llm_int8_has_fp16_weight: False
15
+ - bnb_4bit_quant_type: nf4
16
+ - bnb_4bit_use_double_quant: True
17
+ - bnb_4bit_compute_dtype: bfloat16
18
+
19
+ The following `bitsandbytes` quantization config was used during training:
20
+ - quant_method: bitsandbytes
21
+ - load_in_8bit: False
22
+ - load_in_4bit: True
23
+ - llm_int8_threshold: 6.0
24
+ - llm_int8_skip_modules: None
25
+ - llm_int8_enable_fp32_cpu_offload: False
26
+ - llm_int8_has_fp16_weight: False
27
+ - bnb_4bit_quant_type: nf4
28
+ - bnb_4bit_use_double_quant: True
29
+ - bnb_4bit_compute_dtype: bfloat16
30
+
31
  The following `bitsandbytes` quantization config was used during training:
32
  - quant_method: bitsandbytes
33
  - load_in_8bit: False
 
53
  - bnb_4bit_compute_dtype: bfloat16
54
  ### Framework versions
55
 
56
+ - PEFT 0.4.0
57
+ - PEFT 0.4.0
58
  - PEFT 0.4.0
59
 
60
  - PEFT 0.4.0
checkpoint-1838/adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4eda3217aded50f36e418cb7d97851e9eaa81b0e8fa679e77810af7d6fe6be36
3
  size 109098378
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b31a0e1c9c827d22be801bfcc5ce6e1f13b3be6d3428b45d5ecfe70fb9c55375
3
  size 109098378
checkpoint-1838/optimizer.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:94b79b4c9329483f7de581b06aef35cf82e5367e1fc9342a7a96cfe1e5c9bbea
3
  size 218211962
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09e46657c8993c73091cbaf7238a1df24deefad9ca2c41c294408426aae41a8d
3
  size 218211962
checkpoint-1838/scheduler.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:34191a7ea0695a8c9086d8ecce14c19e63cc47a28062ad048af20c1593f60f40
3
  size 1064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3fa90ea085bfd0d6896e62475ae00bdb78d441c7b944d7db5e68a19d8191e3b0
3
  size 1064
checkpoint-1838/trainer_state.json CHANGED
The diff for this file is too large to render. See raw diff
 
checkpoint-1838/training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c4b8350294128d703631b3a0db99a6d2df9fea125d179eabb76d3d0f0769148d
3
  size 4856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75c3f8568aaf8b5dfbcb892da714ab8dbe1198201deb9ebda1b395708f7006af
3
  size 4856