alfraser commited on
Commit
b7d34d8
·
1 Parent(s): f443824

Added an example of the training script which I would not normally check in, with the hugging face secret token dummied out.

Browse files
Files changed (1) hide show
  1. data/fine_tuning/train_dummy.zsh +9 -0
data/fine_tuning/train_dummy.zsh ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ #!/bin/zsh
2
+
3
+ # DUMMY EXAMPLE OF THE GENERATED FINE-TUNING TRAINING SCRIPT. THIS WILL NOT RUN OR WORK!!!
4
+
5
+ echo "STARTING TRAINING AND PUSH TO HUB"
6
+ start=$(date +%s)
7
+ autotrain llm --train --project-name 02-baseline-llama2-chat-fine-tuned --model meta-llama/Llama-2-7b-chat-hf --data-path . --peft --lr 2e-4 --batch-size 12 --epochs 3 --trainer sft --merge-adapters --push-to-hub --username alfraser --token DUMMY_TOKEN
8
+ end=$(date +%s)
9
+ echo "TRAINING AND PUSH TOOK $(($end-$start)) seconds"