Update README.md

README.md

@@ -1,9 +1,52 @@
 ---
 library_name: peft
+tags:
+- gpt
+- code
+- instruct
+- WizardLM
+datasets:
+- WizardLM/WizardLM_evol_instruct_70k
+base_model: gpt2
+license: apache-2.0
 ---
-## Training procedure
 
-### Framework versions
+### Finetuning Overview:
 
+**Model Used:** gpt2  
+**Dataset:** WizardLM/WizardLM_evol_instruct_70k  
 
-- PEFT 0.5.0
+#### Dataset Insights:
+
+The WizardLM/WizardLM_evol_instruct_70k dataset, tailored specifically for enhancing interactive capabilities, was developed using the EVOL-Instruct method. This method enhances a smaller dataset with tougher questions for the LLM to perform.
+
+#### Finetuning Details:
+
+With the utilization of [MonsterAPI](https://monsterapi.ai)'s [LLM finetuner](https://docs.monsterapi.ai/fine-tune-a-large-language-model-llm), this finetuning:
+
+- Was achieved with great cost-effectiveness.
+- Completed in a total duration of 14mins for 1 epoch.
+- Costed `$0.525` for the entire epoch.
+
+#### Hyperparameters & Additional Details:
+
+- **Epochs:** 1
+- **Cost Per Epoch:** $0.525
+- **Total Finetuning Cost:** $0.525
+- **Model Path:** gpt2
+- **Learning Rate:** 0.0002
+- **Data Split:** 90% train 10% validation
+- **Gradient Accumulation Steps:** 4
+
+```
+### INSTRUCTION:
+[instruction]
+
+### RESPONSE:
+[output]
+```
+Training loss :
+![training loss](train-loss.png "Training loss")
+
+---
+license: apache-2.0