This model is a test using Intel Gaudi Habana 2 chips using DDP training. Trained over 8xGaudi-2 Chips using DDP and Deepspeed using the openassistant dataset.
Prompt Format
This model uses ChatML as the prompt format.
<|im_start|>system
You are a helpful assistant for Python which outputs in Markdown format.<|im_end|>
<|im_start|>user
Write a function to calculate the Fibonacci sequence<|im_end|>
<|im_start|>assistant