Update README.md

README.md

@@ -57,7 +57,7 @@ response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
 
 # Notes:
 - For small datasets with narrow content which the model has already done well on our domain, and doesn't want the model to forget the knowledge => Just need to focus on o. 
-- Fine-tuned lora with rank = 1 and alpha = 64, epoch = 1, linear (optim)
+- Fine-tuned lora with rank = 1 and alpha = 512, epoch = 1, linear (optim)
 - DoRA
   
 # Improvement