Upload korscideberta-abstractcls.ipynb
Browse files
korscideberta-abstractcls.ipynb
CHANGED
@@ -451,7 +451,7 @@
|
|
451 |
"gc.collect()\n",
|
452 |
"from transformers import TrainingArguments\n",
|
453 |
"training_args = TrainingArguments(\n",
|
454 |
-
" output_dir=\"
|
455 |
" num_train_epochs=4, \n",
|
456 |
" #learning_rate=5e-5,\n",
|
457 |
" learning_rate=1.5e-5,\n",
|
@@ -674,6 +674,8 @@
|
|
674 |
"source": [
|
675 |
"## **Evaluate / Analyse the model**\n",
|
676 |
"\n",
|
|
|
|
|
677 |
"Now that we have fine-tuned the model we need to be very careful about analyzing its performance. It's usually not enough to just look at basic metrics defining the quality of a model purely on a metric, such as *accuracy*.\n",
|
678 |
"The better approach is to find a metric that best describes the actual use case of the model.\n",
|
679 |
"\n",
|
@@ -787,7 +789,7 @@
|
|
787 |
"source": [
|
788 |
"#Huggingface์ ์
๋ก๋ํ ํ์ธํ๋ ๋ชจ๋ธ ๋ฐ ์ฑ๋ฅ ํ์ธ\n",
|
789 |
"from transformers import AutoModelForSequenceClassification\n",
|
790 |
-
"model = AutoModelForSequenceClassification.from_pretrained(\"kkmkorea/deberta_sent4455\")
|
791 |
"#model = AutoModelForSequenceClassification.from_pretrained(\"patrickvonplaten/deberta_v3_amazon_reviews\")\n",
|
792 |
"\n",
|
793 |
"trainer = Trainer(\n",
|
|
|
451 |
"gc.collect()\n",
|
452 |
"from transformers import TrainingArguments\n",
|
453 |
"training_args = TrainingArguments(\n",
|
454 |
+
" output_dir=\"deberta_sent4455\",\n",
|
455 |
" num_train_epochs=4, \n",
|
456 |
" #learning_rate=5e-5,\n",
|
457 |
" learning_rate=1.5e-5,\n",
|
|
|
674 |
"source": [
|
675 |
"## **Evaluate / Analyse the model**\n",
|
676 |
"\n",
|
677 |
+
"ํ์ต๋ ํ์ธํ๋ ๋ชจ๋ธ๋ก ์ถ๋ก ๋ฐ ํ๊ฐํ๋ ๋จ๊ณ\n",
|
678 |
+
"\n",
|
679 |
"Now that we have fine-tuned the model we need to be very careful about analyzing its performance. It's usually not enough to just look at basic metrics defining the quality of a model purely on a metric, such as *accuracy*.\n",
|
680 |
"The better approach is to find a metric that best describes the actual use case of the model.\n",
|
681 |
"\n",
|
|
|
789 |
"source": [
|
790 |
"#Huggingface์ ์
๋ก๋ํ ํ์ธํ๋ ๋ชจ๋ธ ๋ฐ ์ฑ๋ฅ ํ์ธ\n",
|
791 |
"from transformers import AutoModelForSequenceClassification\n",
|
792 |
+
"model = AutoModelForSequenceClassification.from_pretrained(\"kkmkorea/deberta_sent4455\") #์์์ ํ์ตํ ํ์ธํ๋ ๋ชจ๋ธ ๊ฒฝ๋ก&์ ์ฅ์\n",
|
793 |
"#model = AutoModelForSequenceClassification.from_pretrained(\"patrickvonplaten/deberta_v3_amazon_reviews\")\n",
|
794 |
"\n",
|
795 |
"trainer = Trainer(\n",
|