Update README.md

README.md

@@ -89,7 +89,7 @@ For ReFT, the nodes in the last 8 layers were unfrozen with attention to allow t
 After 3 to 4 epochs, the model began to overfit regardless of the strategies employed. Increasing both batch size and the number of epochs resulted in higher final training and evaluation cross-entropy.
 
 Following an extensive grid search, supervised fine-tuning of [Llama 3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct) with LoRA+ and the parameters mentioned below yielded the best training and evaluation cross-entropy. 
-I've chosen the size ratio between the matrices A and B of 8. The matrix A weights were initialized using the He method, while the matrix B values started with zero. A Gaussian initialization of weights was also considered, but led to a suboptimal result.
+I've chosen the size ratio between the matrices A and B of 8. The matrix A weights were initialized using the He method, while the matrix B values started with zero. Different Gaussian initialization of weights were also considered, but led to a suboptimal result. Since a custome optimizer was built here, I will share the optimizer code on my private GitHub account soon.
 #### Preprocessing [optional]
 
 [Coming soon]