Update README.md
Browse filesChanged description. Added links guiding users to my final fine tuned model
README.md
CHANGED
@@ -1,3 +1,21 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
license: apache-2.0
|
2 |
language:
|
3 |
- en
|
@@ -6,8 +24,12 @@ metrics:
|
|
6 |
base_model:
|
7 |
- microsoft/phi-2
|
8 |
pipeline_tag: question-answering
|
9 |
-
library_name: fastai
|
10 |
---
|
|
|
|
|
|
|
|
|
|
|
11 |
# Model Card for PEFT-Fine-Tuned Model
|
12 |
|
13 |
This model card documents a PEFT-fine-tuned version of `microsoft/phi-2` for question-answering tasks. The PEFT fine-tuning improved the model's performance, as detailed in the evaluation section.
|
@@ -96,4 +118,4 @@ The model's performance was evaluated using the ROUGE metric. Below are the resu
|
|
96 |
| **Optimizer** | Paged AdamW (8-bit) |
|
97 |
| **Logging Steps** | 25 |
|
98 |
| **Evaluation Steps** | 25 |
|
99 |
-
| **Gradient Checkpointing** | Enabled |
|
|
|
1 |
+
---
|
2 |
+
base_model: microsoft/phi-2
|
3 |
+
library_name: peft
|
4 |
+
license: apache-2.0
|
5 |
+
datasets:
|
6 |
+
- neil-code/dialogsum-test
|
7 |
+
language:
|
8 |
+
- en
|
9 |
+
metrics:
|
10 |
+
- bleu
|
11 |
+
pipeline_tag: question-answering
|
12 |
+
tags:
|
13 |
+
- QuestionAnswering
|
14 |
+
- legal
|
15 |
+
- finan
|
16 |
+
- chem
|
17 |
+
- biology
|
18 |
+
---
|
19 |
license: apache-2.0
|
20 |
language:
|
21 |
- en
|
|
|
24 |
base_model:
|
25 |
- microsoft/phi-2
|
26 |
pipeline_tag: question-answering
|
|
|
27 |
---
|
28 |
+
|
29 |
+
|
30 |
+
|
31 |
+
This repo containes the last checkpoint of my fine tuned model. Click this link to go the final model
|
32 |
+
https://huggingface.co/JamieAi33/Phi-2_PEFT
|
33 |
# Model Card for PEFT-Fine-Tuned Model
|
34 |
|
35 |
This model card documents a PEFT-fine-tuned version of `microsoft/phi-2` for question-answering tasks. The PEFT fine-tuning improved the model's performance, as detailed in the evaluation section.
|
|
|
118 |
| **Optimizer** | Paged AdamW (8-bit) |
|
119 |
| **Logging Steps** | 25 |
|
120 |
| **Evaluation Steps** | 25 |
|
121 |
+
| **Gradient Checkpointing** | Enabled |
|