Training in progress, epoch 0

README.md

@@ -0,0 +1,59 @@
+---
+license: apache-2.0
+library_name: peft
+tags:
+- trl
+- sft
+- generated_from_trainer
+base_model: mistralai/Mistral-7B-Instruct-v0.2
+model-index:
+- name: mistral_envs_claim
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# mistral_envs_claim
+
+This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the None dataset.
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.0002
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- gradient_accumulation_steps: 5
+- total_train_batch_size: 40
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: cosine
+- training_steps: 500
+- mixed_precision_training: Native AMP
+
+### Training results
+
+
+
+### Framework versions
+
+- PEFT 0.10.0
+- Transformers 4.39.3
+- Pytorch 2.1.0a0+29c30b1
+- Datasets 2.18.0
+- Tokenizers 0.15.2

adapter_config.json

@@ -20,8 +20,8 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "v_proj",
-    "q_proj"
+    "q_proj",
+    "v_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:88180baa856a24e60c5a482ef363bce4939de1a01b651b04b66619a8d6ed9de3
+oid sha256:e919f66d238b41a32aba706e46b7bd8bb4a955a15e4136deaf457648f34c1bae
 size 27280152

runs/Apr16_11-53-31_cdba07e56704/events.out.tfevents.1713268435.cdba07e56704.434.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e5bc9c2e554da4650f970a09a43e089c92aead688a79148f527e9368c5cda82b
-size 5966
+oid sha256:23150b411bb58789b663cd50ac49b356bdd99b3f4d548641e6b1cc574da07dc9
+size 7586

runs/Apr17_04-47-50_dafcee725dfa/events.out.tfevents.1713329270.dafcee725dfa.433.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:889dcaeb8c826dcc51a29608f68ecbc842bb352ee45de6ea6b76d6be8eeabd6c
+size 5337

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:05e60ad91a2c6b1691df688daf5143ff14309a6339342ece672e999c2bce40e2
+oid sha256:d92028dd3752be03883989caf22bf262ea1e1b99497ab6b471c4b03268872503
 size 4984