Update README.md

README.md

@@ -29,10 +29,16 @@ Can I ask a question?<|im_end|>
 
 ## Credits
 
+Three new general purpose instruction following datasets were added on top of the original Stheno dataset (which had certain low quality entries purged/removed).
+The first two were designed specifically for the Magnum series, to better address prompt adherence and coherence:
+- [kalomaze/Opus_Instruct_25k](https://huggingface.co/datasets/kalomaze/Opus_Instruct_25k)
+- [Nopm/Opus_WritingStruct](https://huggingface.co/datasets/Nopm/Opus_WritingStruct)
+- [Gryphe/Sonnet3.5-SlimOrcaDedupCleaned](https://huggingface.co/datasets/Gryphe/Sonnet3.5-SlimOrcaDedupCleaned) (A ~16k rows subset)
+
 This model has been a team effort, and the credits goes to all members of Anthracite.
 
 ## Training
-The training was done with a decent amount of high-quality RP data, over 1.5 epochs. We used 8x [NVIDIA H100 Tensor Core](https://www.nvidia.com/en-us/data-center/h100/) GPUs for the full-parameter fine-tuning of the model.
+The training was done for 2 epochs with a learning rate of 1e-05. We used 8x [NVIDIA H100 Tensor Core](https://www.nvidia.com/en-us/data-center/h100/) GPUs for the full-parameter fine-tuning of the model.
 
 [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)