Update README.md

README.md

@@ -91,6 +91,7 @@ After 3 to 4 epochs, the model began to overfit regardless of the strategies emp
 
 Following an extensive grid search, supervised fine-tuning of [Llama 3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct) with LoRA+ and the parameters mentioned below yielded the best training and evaluation cross-entropy. 
 I've chosen the size ratio between the matrices A and B of 8. The matrix A weights were initialized using the He method, while the matrix B values started with zero. Different Gaussian initialization of weights were also considered, but led to a suboptimal result. Since a custom optimizer was built here, I will share the optimizer code on my private GitHub account soon.
+
 #### Preprocessing [optional]
 
 [Coming soon]
@@ -122,7 +123,19 @@ Please see the graph below:
 
 <img src="https://i.ibb.co/SB4gyQf/crossentropy.png" alt="Alt text" style="width:50%;"/>
 
-The final evaluation cross-entropy ended around 0.4.
+The final evaluation cross-entropy ended around 0.4 for this model.
+
+
+
+|  | Loss | 
+|:------------------|:---------------------------|
+| **LORA**     | 0.4603                  |
+| **LORA+** | 0.4011    | 
+| **DORA**|  0.4182         |
+| **qLORA (for 70b model)**| 0.3694          | 
+| **qLORA (for 8b model)**| 0.5471         |  
+| **(LO)ReFT**| 0.4824         |  
+
 
 #### Metrics