End of training

README.md

@@ -10,6 +10,7 @@ metrics:
 model-index:
 - name: Llama-2-7b-hf-finetuned-mrpc
   results: []
+library_name: peft
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -37,6 +38,17 @@ More information needed
 
 ## Training procedure
 
+
+The following `bitsandbytes` quantization config was used during training:
+- load_in_8bit: True
+- load_in_4bit: False
+- llm_int8_threshold: 6.0
+- llm_int8_skip_modules: None
+- llm_int8_enable_fp32_cpu_offload: False
+- llm_int8_has_fp16_weight: False
+- bnb_4bit_quant_type: fp4
+- bnb_4bit_use_double_quant: False
+- bnb_4bit_compute_dtype: float32
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
@@ -76,6 +88,7 @@ The following hyperparameters were used during training:
 
 ### Framework versions
 
+- PEFT 0.4.0
 - Transformers 4.31.0
 - Pytorch 2.0.1+cu118
 - Datasets 2.14.5

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a6a5dbe69a91bfbd18840349c93876b1c2f0f8b56f1b2d8e3246d8002e2f933e
+oid sha256:9a093a08fdd909aad620a73d18c6362c4cdf19d4249572828c3370d02821935d
 size 345151

runs/Sep25_21-52-54_588614263c59/events.out.tfevents.1695682444.588614263c59.1795.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:17f98886165e4a08b41e22257f6e1316cf3730f1ad75f3c0f23813bf91ceeea0
+size 8920

runs/Sep25_22-58-42_588614263c59/events.out.tfevents.1695682727.588614263c59.24754.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e6c9593647e001c7171b241fc45d6402fd08d6c3f73ac8eca9cb7ff7d4469444
+size 4808

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:970625f54bb296fd129dd93d521eb46718927fa1928654711c3aced2c71e44a6
+oid sha256:c625e877c4a2f1ddb063621270f02847f7379c088d69ab1d86d2cd6c8dc48930
 size 4027