basic training
Browse files
README.md
CHANGED
@@ -5,15 +5,15 @@ library_name: peft
|
|
5 |
|
6 |
|
7 |
The following `bitsandbytes` quantization config was used during training:
|
8 |
-
- load_in_8bit:
|
9 |
-
- load_in_4bit:
|
10 |
- llm_int8_threshold: 6.0
|
11 |
- llm_int8_skip_modules: None
|
12 |
- llm_int8_enable_fp32_cpu_offload: False
|
13 |
- llm_int8_has_fp16_weight: False
|
14 |
-
- bnb_4bit_quant_type:
|
15 |
-
- bnb_4bit_use_double_quant:
|
16 |
-
- bnb_4bit_compute_dtype:
|
17 |
### Framework versions
|
18 |
|
19 |
|
|
|
5 |
|
6 |
|
7 |
The following `bitsandbytes` quantization config was used during training:
|
8 |
+
- load_in_8bit: True
|
9 |
+
- load_in_4bit: False
|
10 |
- llm_int8_threshold: 6.0
|
11 |
- llm_int8_skip_modules: None
|
12 |
- llm_int8_enable_fp32_cpu_offload: False
|
13 |
- llm_int8_has_fp16_weight: False
|
14 |
+
- bnb_4bit_quant_type: fp4
|
15 |
+
- bnb_4bit_use_double_quant: False
|
16 |
+
- bnb_4bit_compute_dtype: float32
|
17 |
### Framework versions
|
18 |
|
19 |
|