Update README.md
Browse files
README.md
CHANGED
@@ -42,6 +42,22 @@ KorSciDeBERTa๋ Microsoft DeBERTa ๋ชจ๋ธ์ ์ํคํ
์ณ๋ฅผ ๊ธฐ๋ฐ์ผ๋ก, ๋
ผ
|
|
42 |
|
43 |
- Mecab ์ค์น ์ฐธ๊ณ : ๋ค์ ๋งํฌ์์ '์ฌ์ฉ๋ฐฉ๋ฒ'. https://aida.kisti.re.kr/model/9bbabd2d-6ce8-44cc-b2a3-69578d23970a
|
44 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
45 |
2. git clone https://huggingface.co/kisti/korscideberta; cd korscideberta
|
46 |
|
47 |
- **korscideberta-abstractcls.ipynb**
|
@@ -52,7 +68,7 @@ from transformers import AutoModelForSequenceClassification
|
|
52 |
|
53 |
|
54 |
tokenizer = DebertaV2Tokenizer.from_pretrained("kisti/korscideberta")
|
55 |
-
model = AutoModelForSequenceClassification.from_pretrained("kisti/korscideberta", num_labels=
|
56 |
#model = AutoModelForMaskedLM.from_pretrained("kisti/korscideberta")
|
57 |
''''''
|
58 |
train_metrics = trainer.train().metrics
|
|
|
42 |
|
43 |
- Mecab ์ค์น ์ฐธ๊ณ : ๋ค์ ๋งํฌ์์ '์ฌ์ฉ๋ฐฉ๋ฒ'. https://aida.kisti.re.kr/model/9bbabd2d-6ce8-44cc-b2a3-69578d23970a
|
44 |
|
45 |
+
- Colab ์ฌ์ฉํ๋ ๊ฒฝ์ฐ Mecab ์ค์น:
|
46 |
+
|
47 |
+
<pre><code>
|
48 |
+
! git clone https://github.com/SOMJANG/Mecab-ko-for-Google-Colab.git
|
49 |
+
% cd Mecab-ko-for-Google-Colab/
|
50 |
+
! bash install_mecab-ko_on_colab_light_220429.sh
|
51 |
+
|
52 |
+
</code></pre>
|
53 |
+
|
54 |
+
- ImportError: accelerate>=0.20.1 ์๋ฌ ๋ฐ์์ ํด๊ฒฐ๋ฒ
|
55 |
+
|
56 |
+
!pip install -U accelerate; pip install -U transformers; pip install pydantic==1.8
|
57 |
+
|
58 |
+
: ์ค์น ํ ๋ฐํ์ ์ฌ์์
|
59 |
+
|
60 |
+
|
61 |
2. git clone https://huggingface.co/kisti/korscideberta; cd korscideberta
|
62 |
|
63 |
- **korscideberta-abstractcls.ipynb**
|
|
|
68 |
|
69 |
|
70 |
tokenizer = DebertaV2Tokenizer.from_pretrained("kisti/korscideberta")
|
71 |
+
model = AutoModelForSequenceClassification.from_pretrained("kisti/korscideberta", num_labels=7, hidden_dropout_prob=0.1, attention_probs_dropout_prob=0.1)
|
72 |
#model = AutoModelForMaskedLM.from_pretrained("kisti/korscideberta")
|
73 |
''''''
|
74 |
train_metrics = trainer.train().metrics
|