| library_name: transformers | |
| datasets: | |
| - HuggingFaceH4/ultrachat_200k | |
| finetuned_from: google/gemma-7b | |
| # Gemma 7B Zephyr SFT | |
| The [Zephyr](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) SFT recipe applied on top of Gemma 7B | |
| ## Recipe | |
| We trained using the [alignment handbook recipe](https://github.com/huggingface/alignment-handbook/blob/main/scripts/run_sft.py) and logging to W&B | |
| Visit the [W&B workspace here](https://wandb.ai/llm_surgery/gemma-zephyr?nw=nwusercapecape) | |