Added more instruction ability to the models training data. cb94d39 verified TroyDoesAI commited on May 18
Further Tuned for 1 Epoch of 8k context examples (300 in total) 9b80104 verified TroyDoesAI commited on May 18
Attempt #2 at Context obedient for 128k context model, trained longer at lower LR. ab78bdb verified TroyDoesAI commited on May 9
1 epoch of Needle In The Haystack dataset converted to my version of the prompt template. bca0a65 verified TroyDoesAI commited on May 8