ibm
/

merlinite-7b

@@ -64,7 +64,7 @@ Foundational skills such as reasoning and compositional skills such as creative
 Additionally, to ensure the data is high-quality and safe, we employ steps to check the questions and answers to ensure that they are grounded and safe. This is done using the same teacher model that generated the data.
-Our training consists of two major phases: knowledge tuning and skills tuning.
 There are two steps in knowledge tuning where the first step learns simple knowledge (short samples) and the second step learns complicated knowledge (longer samples).
 The second step uses replay a replay buffer with data from the first step.
 Both foundational skills and compositional skills are learned during the skills tuning phases, where a replay buffer of data from the knowledge phase is used.

 Additionally, to ensure the data is high-quality and safe, we employ steps to check the questions and answers to ensure that they are grounded and safe. This is done using the same teacher model that generated the data.
+Our training consists of two major phases: knowledge tuning and skills tuning.
 There are two steps in knowledge tuning where the first step learns simple knowledge (short samples) and the second step learns complicated knowledge (longer samples).
 The second step uses replay a replay buffer with data from the first step.
 Both foundational skills and compositional skills are learned during the skills tuning phases, where a replay buffer of data from the knowledge phase is used.