Model save

README.md

@@ -17,6 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
 # mistral-sft-lora-fsdp
 
 This model is a fine-tuned version of [meta-llama/Llama-3.1-70B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-70B-Instruct) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.4034
 
 ## Model description
 
@@ -51,7 +53,7 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| No log        | 1.0   | 1    | 2.0744          |
+| 0.4001        | 1.0   | 1042 | 0.4034          |
 
 
 ### Framework versions

adapter_config.json

@@ -23,13 +23,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "q_proj",
-    "down_proj",
     "k_proj",
-    "gate_proj",
-    "o_proj",
     "v_proj",
-    "up_proj"
+    "q_proj",
+    "up_proj",
+    "o_proj",
+    "down_proj",
+    "gate_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:74080fe3b4e27d8b26948ec99ea7878a5809653f6b478b100162ea3cc0fa7d6b
+oid sha256:25dc9200ba0e17c35af3d705977410efdb61bb811e0bf27e029f6de9b20025b6
 size 828526568

runs/Jan05_11-05-20_gpu-server/events.out.tfevents.1736075303.gpu-server.2867849.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bde0c09869ea73d4db8bfc73745b3636b2d1990c81a469bb086d575ae5b4b40b
-size 49395
+oid sha256:6929c2a159d3cfefa871e6469674e3cf7db1ea05ffbd793c549ac635e1fa68a3
+size 50020