Hugging Face's logo

SEOKDONG
/
llama3.1_korean_v1.2_sft_by_aidx

Text Generation
Safetensors
Korean
llama
ko_leaderboard
korean
conversational
Model card Files Community
SEOKDONG commited on
Commit
59567ca
Β·
verified Β·
1 Parent(s): 7f2d13c

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. README.md +6 -8
  2. config.json +1 -1
  3. generation_config.json +1 -1
  4. model-00001-of-00004.safetensors +1 -1
  5. model-00002-of-00004.safetensors +1 -1
  6. model-00003-of-00004.safetensors +1 -1
  7. model-00004-of-00004.safetensors +1 -1
README.md CHANGED
@@ -10,16 +10,14 @@ metrics:
10
  - accuracy
11
  pipeline_tag: text-generation
12
  tags:
13
- - kr
14
- - ko
15
- - leaderboard
16
  ---
17
  ### β›± ν•΄λ‹Ή λͺ¨λΈμ€μ€ LlaMA3.1을 Foundation λͺ¨λΈλ‘œ ν•˜λŠ” ν•œκ΅­μ–΄ 및 ν•œκ΅­μ˜ λ‹€μ–‘ν•œ
18
  ### 문화에 μ μš©ν•  수 μžˆλ„λ‘ ν•˜κΈ° μœ„ν•΄
19
  ### 개발 λ˜μ—ˆμœΌλ©° 자체 μ œμž‘ν•œ 53개 μ˜μ—­μ˜ ν•œκ΅­μ–΄ 데이터λ₯Ό ν™œμš©ν•˜μ—¬ ν•œκ΅­ μ‚¬νšŒ κ°€μΉ˜μ™€
20
- ### λ¬Έν™”λ₯Ό μ΄ν•΄ν•˜λŠ” λͺ¨λΈ μž…λ‹ˆλ‹€. Thanks for ktds✌
21
-
22
- ### V1.1 ν•™μŠ΅λ°μ΄ν„° μΆ”κ°€: 200K
23
 
24
 
25
  # ❢ λͺ¨λΈ μ„€λͺ…
@@ -62,8 +60,8 @@ tags:
62
  <pre><code>
63
  from transformers import AutoModel, AutoTokenizer
64
 
65
- tokenizer = AutoTokenizer.from_pretrained("SEOKDONG/llama3.0_korean_v1.0_sft")
66
- model = AutoModel.from_pretrained("SEOKDONG/llama3.0_korean_v1.0_sft")
67
 
68
  input_text = """ γ€Œκ΅­λ―Όκ±΄κ°•λ³΄ν—˜λ²•γ€μ œ44μ‘°, γ€Œκ΅­λ―Όκ±΄κ°•λ³΄ν—˜λ²• μ‹œν–‰λ Ήγ€μ œ19μ‘°,γ€Œμ•½κ΄€μ˜ κ·œμ œμ— κ΄€ν•œ 법λ₯ γ€μ œ5μ‘°, γ€Œμƒλ²•γ€μ œ54μ‘° μ°Έμ‘° νŒλ‹¨ ν•΄μ€˜""" + " λ‹΅λ³€:"
69
  inputs = tokenizer(input_text, return_tensors="pt")
 
10
  - accuracy
11
  pipeline_tag: text-generation
12
  tags:
13
+ - ko_leaderboard
14
+ - korean
 
15
  ---
16
  ### β›± ν•΄λ‹Ή λͺ¨λΈμ€μ€ LlaMA3.1을 Foundation λͺ¨λΈλ‘œ ν•˜λŠ” ν•œκ΅­μ–΄ 및 ν•œκ΅­μ˜ λ‹€μ–‘ν•œ
17
  ### 문화에 μ μš©ν•  수 μžˆλ„λ‘ ν•˜κΈ° μœ„ν•΄
18
  ### 개발 λ˜μ—ˆμœΌλ©° 자체 μ œμž‘ν•œ 53개 μ˜μ—­μ˜ ν•œκ΅­μ–΄ 데이터λ₯Ό ν™œμš©ν•˜μ—¬ ν•œκ΅­ μ‚¬νšŒ κ°€μΉ˜μ™€
19
+ ### λ¬Έν™”λ₯Ό μ΄ν•΄ν•˜λŠ” λͺ¨λΈ μž…λ‹ˆλ‹€. ✌
20
+ v0.4 μ§€μ‹œλ¬Έκ³Ό 질문자의 λͺ¨ν˜Έν•˜κ±°λ‚˜ λͺ…ν™•ν•˜μ§€ μ•Šμ€ μ§ˆλ¬Έμ— λŒ€ν•΄ μ˜λ„λ₯Ό νŒŒμ•…ν•˜κ³  λ‹΅λ³€ν•˜λŠ” 데이터 ν•™μŠ΅: 280K
 
21
 
22
 
23
  # ❢ λͺ¨λΈ μ„€λͺ…
 
60
  <pre><code>
61
  from transformers import AutoModel, AutoTokenizer
62
 
63
+ tokenizer = AutoTokenizer.from_pretrained("AIDX-ktds/ktdsbaseLM-v0.15-onbased-llama3.1")
64
+ model = AutoModel.from_pretrained("AIDX-ktds/ktdsbaseLM-v0.15-onbased-llama3.1")
65
 
66
  input_text = """ γ€Œκ΅­λ―Όκ±΄κ°•λ³΄ν—˜λ²•γ€μ œ44μ‘°, γ€Œκ΅­λ―Όκ±΄κ°•λ³΄ν—˜λ²• μ‹œν–‰λ Ήγ€μ œ19μ‘°,γ€Œμ•½κ΄€μ˜ κ·œμ œμ— κ΄€ν•œ 법λ₯ γ€μ œ5μ‘°, γ€Œμƒλ²•γ€μ œ54μ‘° μ°Έμ‘° νŒλ‹¨ ν•΄μ€˜""" + " λ‹΅λ³€:"
67
  inputs = tokenizer(input_text, return_tensors="pt")
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "/workspace/llama3/llama310_2/",
3
  "architectures": [
4
  "LlamaForCausalLM"
5
  ],
 
1
  {
2
+ "_name_or_path": "/workspace/llama3/llama310_4/",
3
  "architectures": [
4
  "LlamaForCausalLM"
5
  ],
generation_config.json CHANGED
@@ -6,7 +6,7 @@
6
  128008,
7
  128009
8
  ],
9
- "repetition_penalty": 1.15,
10
  "temperature": 0.01,
11
  "do_sample": true,
12
  "transformers_version": "4.44.2"
 
6
  128008,
7
  128009
8
  ],
9
+ "repetition_penalty": 1.1,
10
  "temperature": 0.01,
11
  "do_sample": true,
12
  "transformers_version": "4.44.2"
model-00001-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c7dfc67cfdecbf4f1abd15760d6a4d803586aac1d441f5b42b8e0c56fdf565b0
3
  size 4976698592
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e44099508e9486726927793bf7da59e16d3864db76f2dbf07576c26013898918
3
  size 4976698592
model-00002-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2f49da8e31bc03fa0d286e4bbf354beec5c5c1ae465150d27717329e1db51e33
3
  size 4999802616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ad7f309ecba56763efc55e3e2e137f82094e697845a72d9f4caae9a2f7d3b29
3
  size 4999802616
model-00003-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:92155dcafa287eee6453b26b5a8ac04153fc9786e2d15b77489565f2770b4f77
3
  size 4915916080
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b11af43d6a89b604668812b438ffa2f6645cb446d60e20a3c38e813a9bb2930f
3
  size 4915916080
model-00004-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e0aa866f863b6cf717080bf65c5db9c9a50a4a69a9de48d59c7ee580888369df
3
  size 1168138808
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ffe11121a1c83ae7da3c24c59f0ee36a33c41534119409a76a35d3baffe81fb
3
  size 1168138808