Update README.md

README.md

@@ -54,9 +54,26 @@ git clone https://github.com/EleutherAI/lm-evaluation-harness
 cd lm-evaluation-harness
 pip install -e .
 ```
-Each task (arc_challenge|25-shot, hellaswag|10-shot, hendrycksTest-*|5-shot, truthfulqa_mc|0-shot) was evaluated on a single A100 80GB GPU, using the following:
+Each task was evaluated on a single A100 80GB GPU.
+
+ARC
+```
+python main.py --model hf-causal-experimental --model_args pretrained=lilloukas/Platypus-30B --tasks arc_challenge --batch_size 1 --no_cache --write_out --output_path results/Platypus-30B/arc_challenge_25shot.json --device cuda --num_fewshot 25
+```
+
+HellaSwag
+```
+python main.py --model hf-causal-experimental --model_args pretrained=lilloukas/Platypus-30B --tasks hellaswag --batch_size 1 --no_cache --write_out --output_path results/Platypus-30B/hellaswag_10shot.json --device cuda --num_fewshot 10
+```
+
+MMLU
+```
+python main.py --model hf-causal-experimental --model_args pretrained=lilloukas/Platypus-30B --tasks hendrycksTest-* --batch_size 1 --no_cache --write_out --output_path results/Platypus-30B/mmlu_5shot.json --device cuda --num_fewshot 5
+```
+
+TruthfulQA
 ```
-python main.py --model hf-causal-experimental --model_args pretrained=lilloukas/Platypus-30B --tasks <TASK> --batch_size 1 --no_cache --write_out --output_path results/Platypus-30B/<TASK>.json --device cuda --num_fewshot <NUM_FEWSHOT>
+python main.py --model hf-causal-experimental --model_args pretrained=lilloukas/Platypus-30B --tasks truthfulqa_mc --batch_size 1 --no_cache --write_out --output_path results/Platypus-30B/truthfulqa_0shot.json --device cuda
 ```
 ## Limitations and bias