PEFT
Safetensors
Korean

Ko-genstruct v0.1

Ko-genstruct๋Š” ์ฃผ์–ด์ง„ ๋ฌธ์„œ๋กœ๋ถ€ํ„ฐ instruction tuning์— ํ•„์š”ํ•œ instruction์„ ์ƒ์„ฑํ•ด๋‚ด๋Š” ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค. ์‹œํ—˜๋ฌธ์ œ์™€ ๊ธ€์“ฐ๊ธฐ ๋ฌธ์ œ ๋‘๊ฐ€์ง€ ์œ ํ˜•์˜ ์ง€์‹œ๋ฌธ์„ ์ƒ์„ฑํ•ด๋‚ผ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ด ๋ชจ๋ธ์€ Ada-instruct์™€ Genstruct๋กœ๋ถ€ํ„ฐ ์˜๊ฐ์„ ๋ฐ›์•˜์Šต๋‹ˆ๋‹ค.

๋‹ค์Œ๊ณผ ๊ฐ™์€ ์šฉ๋„๋กœ ํ™œ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

  • ๊ฒ€์ƒ‰ ๋ชจ๋ธ์„ ํ•™์Šตํ•˜๊ธฐ ์œ„ํ•ด ์ฃผ์–ด์ง„ ํ…์ŠคํŠธ๋กœ๋ถ€ํ„ฐ ์งˆ๋ฌธ์„ ์ƒ์„ฑํ•˜๊ธฐ
  • Instruction Tuning ํ•™์Šต ๋ฐ์ดํ„ฐ๋ฅผ ์ƒ์„ฑํ•˜๊ธฐ ์œ„ํ•ด Ko-genstruct๋กœ instruction์„ ์ƒ์„ฑ ํ›„, ๋‹ค๋ฅธ LLM์„ ์ด์šฉํ•˜์—ฌ ๋‹ต๋ณ€ ์ƒ์„ฑ

Details

์‚ฌ์šฉ๋ฐฉ๋ฒ•

์งˆ๋ฌธ ์ƒ์„ฑ

์•„๋ž˜ ์˜ˆ์ œ๋ฅผ ํ™œ์šฉํ•˜์—ฌ, ์ฃผ์–ด์ง„ ๋ฌธ์„œ๋กœ๋ถ€ํ„ฐ ์ง€์‹œ๋ฌธ์„ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์‹œํ—˜๋ฌธ์ œ์™€ ๊ธ€์“ฐ๊ธฐ ๋ฌธ์ œ ๋‘๊ฐ€์ง€ ํ”„๋กฌํ”„ํŠธ ์œ ํ˜•์ด ์กด์žฌํ•ฉ๋‹ˆ๋‹ค.

import transformers
import peft

model_id = "MLP-KTLim/llama-3-Korean-Bllossom-8B"
peft_model_id = "iknow-lab/ko-genstruct-v0.1"

tokenizer = transformers.AutoTokenizer.from_pretrained(model_id)
model = transformers.AutoModelForCausalLM.from_pretrained(model_id, device_map="auto", torch_dtype="auto").eval()

model.load_adapter(peft_model_id)


title = "์—ฌ๊ธฐ์— ๋ฌธ์„œ ์ œ๋ชฉ ์ž…๋ ฅ"
text = "์—ฌ๊ธฐ์— ๋ฌธ์„œ ๋‚ด์šฉ ์ž…๋ ฅ"

PROMPT_QA = """๋‹น์‹ ์€ ์‹œํ—˜๋ฌธ์ œ ์ถœ์ œ์œ„์›์ž…๋‹ˆ๋‹ค. ๋‹ค์Œ ์ž๋ฃŒ์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์ „๋ฌธ๊ฐ€ ์ˆ˜์ค€์˜ ์‹œํ—˜๋ฌธ์ œ๋ฅผ ์ถœ์ œํ•  ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ž๋ฃŒ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ์ง€์‹œ์‚ฌํ•ญ์— ๋งž๋Š” ๊ฒฐ๊ณผ๋ฌผ์„ json ํ˜•์‹์œผ๋กœ ๋ฐ˜ํ™˜ํ•ด์ฃผ์„ธ์š”.

1. ์ƒ์„ฑํ•œ ๋ฌธ์ œ๋Š” ์‹ค์ƒํ™œ์—์„œ ์‚ฌ์šฉํ•˜๋Š” ์งˆ๋ฌธ์˜ ๋งํˆฌ๋ฅผ ์‚ฌ์šฉํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค(~๋ฌด์—‡์ธ๊ฐ€์š”? ~์ž‘์„ฑํ•ด์ฃผ์„ธ์š”. ~ ์–ด๋–ป๊ฒŒ ํ•ด์•ผํ•˜์ฃ ?)
2. ๋จผ์ € ๊ณ ๋“ฑํ•™๊ต ์ˆ˜์ค€์˜ ๋ฌธ์ œ๋ฅผ ์ƒ์„ฑํ•˜๊ณ , ์ด๋ฅผ ์ „๋ฌธ๊ฐ€ ์ˆ˜์ค€์œผ๋กœ ๊ณ ๋‚œ์ด๋„ ๋ฌธ์ œ๋กœ ํ–ฅ์ƒํ•ด์ฃผ์„ธ์š”. ๊ฐ ๋ฌธ์ œ๋Š” ๋ฐ˜๋“œ์‹œ ์ œ์‹œ๋œ ์ž๋ฃŒ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ๋งŒ๋“ค์–ด์ ธ์•ผ ํ•ฉ๋‹ˆ๋‹ค. ์—ฐ๊ด€์„ฑ์ด ์ ๋”๋ผ๋„, ์ฐฝ์˜์ ์ธ ์•„์ด๋””์–ด๋กœ ํ•ด๋‹น ์ž๋ฃŒ๋ฅผ ํ™œ์šฉํ•˜์„ธ์š”.
3. ๋ฌธ์ œ์—๋Š” ๋‹ต์•ˆ ์ž‘์„ฑ์— ํ•„์š”ํ•œ ๋‚ด์šฉ์„ ์ฃผ์–ด์ง„ ์ž๋ฃŒ์—์„œ ์ถ”์ถœํ•ด์„œ ํ•จ๊ป˜ ์ œ๊ณตํ•ด์•ผํ•ฉ๋‹ˆ๋‹ค.
4. ์ถœ์ œํ•  ๋ฌธ์ œ์˜ ๊ณผ๋ชฉ ํ›„๋ณด๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™์Šต๋‹ˆ๋‹ค: ๊ธ€์“ฐ๊ธฐ, ํ•œ๊ตญ์–ด, ์˜์–ด, ์ˆ˜ํ•™, ์‚ฌํšŒ๊ณผํ•™, ๊ณผํ•™, ์—ญ์‚ฌ ๋ฌธํ™”์˜ˆ์ˆ , ๋ฒ•, ๋„๋•, ์ •์น˜, ์ข…๊ต, ์™ธ๊ตญ์–ด, ๊ฒฝ์ œ, ๊ฒฝ์˜, ์˜๋ฃŒ, ๊ณตํ•™, ์ธ๋ฌธํ•™ ๋“ฑ - ํ›„๋ณด์— ์—†์–ด๋„, ์ ์ ˆํ•œ ๊ณผ๋ชฉ์„ ์ž์œ ๋กญ๊ฒŒ ๋งํ•  ์ˆ˜ ์žˆ๋‹ค.

# ์ œ๋ชฉ: {title}
# ์ž๋ฃŒ:
{text}"""

PROMPT_WRITING = """๋‹น์‹ ์€ ๊ธ€์“ฐ๊ธฐ ์‹œํ—˜๋ฌธ์ œ ์ถœ์ œ์œ„์›์ž…๋‹ˆ๋‹ค. ๋‹ค์Œ ์ž๋ฃŒ์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์ „๋ฌธ๊ฐ€ ์ˆ˜์ค€์˜ ์‹œํ—˜๋ฌธ์ œ๋ฅผ ์ถœ์ œํ•  ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ž๋ฃŒ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ์ง€์‹œ์‚ฌํ•ญ์— ๋งž๋Š” ๊ฒฐ๊ณผ๋ฌผ์„ json ํ˜•์‹์œผ๋กœ ๋ฐ˜ํ™˜ํ•ด์ฃผ์„ธ์š”.

1. ์ƒ์„ฑํ•œ ๋ฌธ์ œ๋Š” ์‹ค์ƒํ™œ์—์„œ ์‚ฌ์šฉํ•˜๋Š” ์งˆ๋ฌธ์˜ ๋งํˆฌ๋ฅผ ์‚ฌ์šฉํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค(~๋ฌด์—‡์ธ๊ฐ€์š”? ~์ž‘์„ฑํ•ด์ฃผ์„ธ์š”. ~ ์–ด๋–ป๊ฒŒ ํ•ด์•ผํ•˜์ฃ ?)
2. ๋จผ์ € ๊ณ ๋“ฑํ•™๊ต ์ˆ˜์ค€์˜ ๋ฌธ์ œ๋ฅผ ์ƒ์„ฑํ•˜๊ณ , ์ด๋ฅผ ์ „๋ฌธ๊ฐ€ ์ˆ˜์ค€์œผ๋กœ ๊ณ ๋‚œ์ด๋„ ๋ฌธ์ œ๋กœ ํ–ฅ์ƒํ•ด์ฃผ์„ธ์š”. ๊ฐ ๋ฌธ์ œ๋Š” ๋ฐ˜๋“œ์‹œ ์ œ์‹œ๋œ ์ž๋ฃŒ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ๋งŒ๋“ค์–ด์ ธ์•ผ ํ•ฉ๋‹ˆ๋‹ค. ์—ฐ๊ด€์„ฑ์ด ์ ๋”๋ผ๋„, ์ฐฝ์˜์ ์ธ ์•„์ด๋””์–ด๋กœ ํ•ด๋‹น ์ž๋ฃŒ๋ฅผ ํ™œ์šฉํ•˜์„ธ์š”.
3. ๋ฌธ์ œ์—๋Š” ๊ธ€์“ฐ๊ธฐ ์ž‘์„ฑ์— ํ•„์š”ํ•œ ๋‚ด์šฉ์„ ์ฃผ์–ด์ง„ ์ž๋ฃŒ์—์„œ ์ถ”์ถœํ•ด์„œ ํ•จ๊ป˜ ์ œ๊ณตํ•ด์•ผํ•ฉ๋‹ˆ๋‹ค.
4. ์ถœ์ œํ•  ๋ฌธ์ œ์˜ ์ฃผ์ œ ํ›„๋ณด๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™์Šต๋‹ˆ๋‹ค. ์ด ์ค‘์—์„œ ์ ์ ˆํ•œ ์ฃผ์ œ๋ฅผ 3๊ฐ€์ง€ ์„ ํƒํ•˜์„ธ์š”: ์ด๋ ฅ์„œ, ๋…ธ๋ž˜๊ฐ€์‚ฌ, ์‹œ ํ˜น์€ ์†Œ์„ค, ์—์„ธ์ด, ๊ทน๋ณธ, ์‹œ๋‚˜๋ฆฌ์˜ค, ์—ฌํ–‰์ผ๊ธฐ, ์—ฌํ–‰๊ณ„ํš์„œ, ์š”๋ฆฌ๋ ˆ์‹œํ”ผ, ํ•ด์„ค, ์ž๊ธฐ์†Œ๊ฐœ์„œ, ํŽธ์ง€, ์ด๋ฉ”์ผ, ๋ฆฌ๋ทฐ ๋ฐ ํ‰๊ฐ€, ์†Œ์…œ ๋ฏธ๋””์–ด ํฌ์ŠคํŠธ, ์ผ๊ธฐ, ์ฒญ์›์„œ, ํ•ญ์˜์„œ, ์‡ผํ•‘ ๋ฆฌ์ŠคํŠธ, ๋ฉ”๋ชจ, ์—ฐ๊ตฌ ๋…ผ๋ฌธ ๋ฐ ๊ณ„ํš์„œ, ๋น„์ฆˆ๋‹ˆ์Šค ๋ณด๊ณ ์„œ ๋ฐ ๊ฒŒํš์„œ, ๊ธฐ์ˆ  ๋ฌธ์„œ, ๋ฐœํ‘œ์ž๋ฃŒ, ๊ณ„์•ฝ์„œ ํ˜น์€ ๋ฒ•๋ฅ  ๋ฌธ์„œ, ํŽธ์ง‘ ๋ฐ ์ถœํŒ ๋ฌธ์„œ, ๊ด‘๊ณ  ์นดํ”ผ๋ผ์ดํŠธ, ์›น ์ฝ˜ํ…์ธ , ๋‰ด์Šค๋ ˆํ„ฐ, ์—ฐ์„ค๋ฌธ, ์ž๊ธฐ๊ณ„๋ฐœ์„œ, ๋ถ„์„๋ณด๊ณ ์„œ, ๊ธฐํš์•ˆ, ์ œ์•ˆ์„œ

# ์ œ๋ชฉ: {title}
# ์ž๋ฃŒ:
{text}"""

def generate_question(title, text, is_writing: bool = False):
    prompt=PROMPT_WRITING if is_writing else PROMPT_QA
    prompt = prompt.format(title=title, text=text)
    
    prompt = [{"content": prompt, "role": "user"}]
    inputs = tokenizer.apply_chat_template(prompt, return_tensors="pt", add_generation_prompt=True, tokenize=False)
    inputs = inputs.strip() + "\n\n```json\n{\n  \"topic\":"
    inputs = tokenizer.encode(inputs, add_special_tokens=False, return_tensors="pt").to(model.device)
    outputs = model.generate(input_ids=inputs, max_new_tokens=256, do_sample=True, early_stopping=True, eos_token_id=128009, temperature=1.0)

    question = tokenizer.decode(outputs[0, inputs.shape[1]:], skip_special_tokens=False)

    return question

print("Question generation test")
for _ in range(5):
    question = generate_question(title, text)
    print(question)

print("Writing generation test")
for _ in range(5):
    question = generate_question(title, text, True)
    print(question)

์ƒ์„ฑ ๊ฒฐ๊ณผ

์˜ˆ์‹œ 1: ์•„์ฃผ๋Œ€ํ•™๊ต ํ•™์น™

์ž…๋ ฅ

title = "์•„์ฃผ๋Œ€ํ•™๊ต ํ•™์น™"
text = """
์ œ1์žฅ ์ด์น™

์ œ1์กฐ(๋ชฉ์ ) ์ด ํ•™์น™์€ ์•„์ฃผ๋Œ€ํ•™๊ต(์ดํ•˜โ€œ๋ณธ ๋Œ€ํ•™๊ตโ€๋ผ ํ•œ๋‹ค)์˜ ์ด๋…์„ ์„ค์ •ํ•˜๊ณ  ์ด๋ฅผ ๋‹ฌ์„ฑํ•˜๋Š”๋ฐ ํ•„์š”ํ•œ ์‚ฌํ•ญ์„ ๊ทœ์ •ํ•จ์„ ๋ชฉ์ ์œผ๋กœ ํ•œ๋‹ค.

์ œ2์กฐ(๋Œ€ํ•™์ด๋…) ๋ณธ ๋Œ€ํ•™๊ต๋Š” ๋Œ€ํ•œ๋ฏผ๊ตญ ๊ต์œก์˜ ๊ทผ๋ณธ์ด๋…์— ์ž…๊ฐํ•˜์—ฌ ์ธ๊ฐ„์กด์ค‘, ์‹ค์‚ฌ๊ตฌ์‹œ, ์„ธ๊ณ„์ผ๊ฐ€์˜ ์ •์‹ ์œผ๋กœ ๊ตญ๊ฐ€ ๋ฐ ์ธ๋ฅ˜์‚ฌํšŒ์˜ ๋ฐœ์ „์— ๊ธฐ์—ฌํ•  ์ˆ˜ ์žˆ๋Š” ์œ ๋Šฅํ•œ ์ธ์žฌ๋ฅผ ์–‘์„ฑํ•˜๊ณ  ํ•™์ˆ ์˜ ์‹ฌ์˜คํ•œ ์ด๋ก ๊ณผ ๊ทธ ๊ด‘๋ฒ”ํ•˜๊ณ  ์ •์น˜ํ•œ ์‘์šฉ๋ฐฉ๋ฒ•์„ ์—ฐ๊ตฌํ•˜๋ฉฐ ๊ต์œกใ†์—ฐ๊ตฌ์˜ ๋Šฅ๋ ฅ๊ณผ ์‹œ์„ค์„ ํ™œ์šฉํ•˜์—ฌ ์‚ฌํšŒ์— ์ง์ ‘ ๋ด‰์‚ฌํ•˜๋Š” ๊ฒƒ์„ ๋ชฉํ‘œ๋กœ ํ•œ๋‹ค.

์ œ3์กฐ(์ •์˜) โ‘ โ€œํ•™์‚ฌ๊ณผ์ •โ€์ด๋ผ ํ•จ์€ ํ•™์‚ฌํ•™์œ„๋ฅผ ์ˆ˜์—ฌํ•˜๊ธฐ ์œ„ํ•œ ๊ณผ์ •์„ ๋งํ•œ๋‹ค.
   โ‘กโ€œ์„์‚ฌ๊ณผ์ •โ€์ด๋ผ ํ•จ์€ ์„์‚ฌํ•™์œ„๋ฅผ,โ€œ๋ฐ•์‚ฌ๊ณผ์ •โ€์ด๋ผ ํ•จ์€ ๋ฐ•์‚ฌํ•™์œ„๋ฅผ,โ€œ์„ใ†๋ฐ•์‚ฌํ†ตํ•ฉ๊ณผ์ •โ€์ด๋ผ ํ•จ์€ ํ•™์‚ฌ์—๊ฒŒ ๋ฐ•์‚ฌํ•™์œ„๋ฅผ ๊ฐ๊ฐ ์ˆ˜์—ฌํ•˜๊ธฐ ์œ„ํ•œ ๊ณผ์ •์„ ๋งํ•œ๋‹ค.
   โ‘ขโ€œ๋Œ€ํ•™์›๊ณผ์ •โ€์ด๋ผ ํ•จ์€ ๋ณธ ๋Œ€ํ•™๊ต ์ผ๋ฐ˜๋Œ€ํ•™์›, ์ „๋ฌธ๋Œ€ํ•™์› ๋ฐ ํŠน์ˆ˜๋Œ€ํ•™์›์— ์„ค์น˜๋œ ์„์‚ฌ๊ณผ์ •, ๋ฐ•์‚ฌ๊ณผ์ • ๋ฐ ์„ใ†๋ฐ•์‚ฌํ†ตํ•ฉ๊ณผ์ • ๋ชจ๋‘๋ฅผ ๋งํ•œ๋‹ค.
   โ‘ฃโ€œํ•™๊ณผ๊ฐ„ํ˜‘๋™๊ณผ์ •โ€์ด๋ผ ํ•จ์€ ๋Œ€ํ•™์›๊ณผ์ • ์•ˆ์— 2๊ฐœ ์ด์ƒ์˜ ํ•™๊ณผ๊ฐ€ ๊ณต๋™์œผ๋กœ ์„ค์น˜ใ†์šด์˜ํ•˜๋Š” ๊ณผ์ •์„ ๋งํ•œ๋‹ค. (๊ฐœ์ • 2013.7.5)
   โ‘คโ€œํ•™์—ฐ์‚ฐํ˜‘๋™๊ณผ์ •โ€์ด๋ผ ํ•จ์€ ๋Œ€ํ•™์›๊ณผ์ • ์•ˆ์— ์—ฐ๊ตฌ๊ธฐ๊ด€ ๋˜๋Š” ์‚ฐ์—…์ฒด์™€์˜ ๊ณ„์•ฝ์— ์˜ํ•˜์—ฌ ์„ค์น˜ใ†์šด์˜ํ•˜๋Š” ํ•™ใ†์—ฐใ†์‚ฐ, ํ•™ใ†์—ฐ ๋˜๋Š” ํ•™ใ†์‚ฐ ํ˜‘๋™๊ณผ์ •์„ ๋งํ•œ๋‹ค.
   โ‘ฅโ€œํ•™ใ†์„์‚ฌ์—ฐ๊ณ„๊ณผ์ •โ€์ด๋ผ ํ•จ์€ ๋ณธ ๋Œ€ํ•™๊ต ํ•™์‚ฌ๊ณผ์ •๊ณผ ์ผ๋ฐ˜๋Œ€ํ•™์› ์„์‚ฌ๊ณผ์ •์„ ์—ฐ๊ณ„ํ•˜๋Š” ๊ณผ์ •์„ ๋งํ•œ๋‹ค. (์‹ ์„ค 2008.5.21)
   โ‘ฆโ€œํŠน์ˆ˜ํ•™๋ถ€โ€๋ผ ํ•จ์€ ๋Œ€ํ•™์— ์†Œ์†๋˜์–ด ์žˆ์ง€ ์•Š์€ ๋…๋ฆฝํ•™๋ถ€๋ฅผ ๋งํ•œ๋‹ค. (๊ฐœ์ • 2008.5.21) (๊ฐœ์ • 2010.7.21)
   โ‘ง โ€œ์ „๋ฌธ๊ณผ์ •โ€์ด๋ผ ํ•จ์€ ํ•™์‚ฌ๊ณผ์ •์—์„œ ๋Œ€์™ธ ๊ต์œก์ธ์ฆ์„ ๋ฐ›๊ธฐ ์œ„ํ•˜์—ฌ ์šด์˜ํ•˜๋Š” ๊ต์œก๊ณผ์ •์„ ๋งํ•œ๋‹ค. (์‹ ์„ค 2011.8.11)


์ œ2์žฅ ์กฐ์ง

์ œ4์กฐ(๊ธฐ๊ตฌ) ๋ณธ ๋Œ€ํ•™๊ต์— ์ด์žฅ, ๊ต๋ฌด๋ถ€์ด์žฅ, ์˜๋ฌด๋ถ€์ด์žฅ, ์‚ฐํ•™๋ถ€์ด์žฅ, ๋Œ€ํ•™, ์ผ๋ฐ˜๋Œ€ํ•™์›, ์ „๋ฌธ๋Œ€ํ•™์›, ํŠน์ˆ˜๋Œ€ํ•™์›, ํŠน์ˆ˜ํ•™๋ถ€, ๋Œ€ํ•™๊ต๋ณธ๋ถ€, ๋ถ€์†๊ธฐ๊ด€, ์—ฐ๊ตฌ๊ธฐ๊ด€, ์ง€์›๊ธฐ๊ด€, ์•„์ฃผ๋Œ€ํ•™๊ต์‚ฐํ•™ํ˜‘๋ ฅ๋‹จ, ์˜๋ฃŒ์›, ์ด์žฅ์ง์†๊ธฐ๊ตฌ, ๋ถ€์ด์žฅ์ง์†๊ธฐ๊ตฌ ๋ฐ ํŠน๋ณ„๊ธฐ๊ตฌ๋ฅผ ๋‘๋ฉฐ, ์„ธ๋ถ€์‚ฌํ•ญ์€ ๋ณ„ํ‘œ1๊ณผ ๊ฐ™๋‹ค. (๊ฐœ์ • 2007.3.26) (๊ฐœ์ • 2007.7.25) (๊ฐœ์ • 2007.9.9) (๊ฐœ์ • 2008.2.22) (๊ฐœ์ • 2008.12.16) (๊ฐœ์ • 2009.2.20) (๊ฐœ์ • 2009.4.2) (๊ฐœ์ • 2009.4.29) (๊ฐœ์ • 2009.7.27) (๊ฐœ์ • 2009.10.18) (๊ฐœ์ • 2009.12.7) (๊ฐœ์ • 2010.2.26) (๊ฐœ์ • 2010.7.21) (๊ฐœ์ • 2011.1.11) (๊ฐœ์ • 2011.8.11) (๊ฐœ์ • 2011.12.23) (๊ฐœ์ • 2012.5.10) (๊ฐœ์ • 2012.7.17) (๊ฐœ์ • 2012.11.19) (๊ฐœ์ • 2013.1.25) (๊ฐœ์ • 2013.5.1) (๊ฐœ์ • 2013.7.30) (๊ฐœ์ • 2013.12.31) (๊ฐœ์ • 2014.5.30) (๊ฐœ์ • 2014.6.30) (๊ฐœ์ • 2015.2.10) (๊ฐœ์ • 2015.05.18) (๊ฐœ์ • 2015.08.13.) (๊ฐœ์ • 2015.10.16) (๊ฐœ์ • 2016.1.8) (๊ฐœ์ • 2016.2.3) (๊ฐœ์ • 2016.3.24) (๊ฐœ์ • 2016.5.9) (๊ฐœ์ • 2016.8.23) (๊ฐœ์ • 2016.12.29) (๊ฐœ์ • 2017.2.13) (๊ฐœ์ • 2017.4.19) (๊ฐœ์ • 2017.7.14) (๊ฐœ์ • 2018.1.31) (๊ฐœ์ • 2018.5.11) (๊ฐœ์ • 2018.8.12) (๊ฐœ์ • 2019.01.15) (๊ฐœ์ • 2019.10.2) (๊ฐœ์ • 2020.  .  )

์ œ5์กฐ(์ด์žฅ) ์ด์žฅ์€ ๊ต๋ฌด๋ฅผ ํ†ตํ• ํ•˜๊ณ  ๋ณธ ๋Œ€ํ•™๊ต๋ฅผ ๋Œ€ํ‘œํ•œ๋‹ค.

์ œ6์กฐ(๋ถ€์ด์žฅ) โ‘  ๊ต๋ฌด๋ถ€์ด์žฅ์€ ์˜๋ฌด(้†ซๅ‹™)์™€ ์‚ฐํ•™ํ˜‘๋ ฅ ์ด์™ธ์˜ ๊ต๋ฌด(ๆ กๅ‹™)์— ๊ด€ํ•˜์—ฌ, ์˜๋ฌด๋ถ€์ด์žฅ์€ ์˜๋ฌด(้†ซๅ‹™)์— ๊ด€ํ•˜์—ฌ ์‚ฐํ•™๋ถ€์ด์žฅ์€ ์‚ฐํ•™ํ˜‘๋ ฅ์— ๊ด€ํ•˜์—ฌ ์ด์žฅ์„ ๋ณด์ขŒํ•˜๋ฉฐ, ๊ฐ ๋ถ€์ด์žฅ์€ ์ด์žฅ์ด ๊ตฌ์ฒด์ ์œผ๋กœ ์œ„์ž„ํ•œ ์—…๋ฌด๋ฅผ ๊ด€์žฅํ•œ๋‹ค. (๊ฐœ์ • 2009.4.2) (๊ฐœ์ • 2015.10.16)
   โ‘ก ์ด์žฅ์ด ๊ถ์œ„๋˜๊ฑฐ๋‚˜ ๊ทธ ์ง๋ฌด๋ฅผ ์ˆ˜ํ–‰ํ•  ์ˆ˜ ์—†๋Š” ์‚ฌ์ •์ด ์žˆ๋Š” ๊ฒฝ์šฐ์—๋Š” ์ด์‚ฌ์žฅ์ด ์ง€๋ช…ํ•˜๋Š” ๋ถ€์ด์žฅ์ด ์ด์žฅ์˜ ์ง๋ฌด๋ฅผ ๋Œ€ํ–‰ํ•œ๋‹ค. (๊ฐœ์ • 2009.4.2) 

์ œ7์กฐ(๋Œ€ํ•™๊ต๋ณธ๋ถ€) โ‘  ๋Œ€ํ•™๊ต๋ณธ๋ถ€์— ๊ต๋ฌด์ฒ˜, ์—ฐ๊ตฌ์ •๋ณด์ฒ˜, ํ•™์ƒ์ฒ˜, ์ด๋ฌด์ฒ˜, ๊ธฐํš์ฒ˜, ์ž…ํ•™์ฒ˜, ๊ตญ์ œํ˜‘๋ ฅ์ฒ˜๋ฅผ ๋‘”๋‹ค. (๊ฐœ์ • 2015.10.16) (๊ฐœ์ • 2017.4.19)
   โ‘ก ๊ฐ ์ฒ˜์˜ ์—…๋ฌด์— ๊ด€ํ•˜์—ฌ๋Š”ใ€Œ์•„์ฃผ๋Œ€ํ•™๊ต ์ง์ œ๊ทœ์ •ใ€์œผ๋กœ ์ •ํ•œ๋‹ค.

์ œ7์กฐ์˜2(ํ‰์ƒํ•™์Šต์ค‘์‹ฌ๋Œ€ํ•™์ถ”์ง„๋ณธ๋ถ€) โ‘ ใ€Œ์•„์ฃผ๋Œ€ํ•™๊ต ์ง์ œ๊ทœ์ •ใ€์ œ5์กฐ ์ œ10ํ•ญ์— ์˜๊ฑฐ ํŠน๋ณ„๊ธฐ๊ตฌ๋กœ ํ‰์ƒํ•™์Šต์ค‘์‹ฌ๋Œ€ํ•™์ถ”์ง„๋ณธ๋ถ€๋ฅผ ๋‘”๋‹ค. (์‹ ์„ค 2009.7.27) (๊ฐœ์ • 2017.7.14)
   โ‘ก ํ‰์ƒํ•™์Šต์ค‘์‹ฌ๋Œ€ํ•™์ถ”์ง„๋ณธ๋ถ€๋Š” ํ‰์ƒ๊ต์œก๊ณผ ๊ด€๋ จํ•œ ์ œ๋ฐ˜์—…๋ฌด๋ฅผ ๊ด€ํ• ํ•œ๋‹ค. (์‹ ์„ค 2009.7.27)
   โ‘ข ํ‰์ƒํ•™์Šต์ค‘์‹ฌ๋Œ€ํ•™์ถ”์ง„๋ณธ๋ถ€ ์šด์˜์— ๋Œ€ํ•ด์„œ๋Š” ์ด์žฅ์ด ๋”ฐ๋กœ ์ •ํ•œ๋‹ค. (์‹ ์„ค 2009.7.27)

์ œ7์กฐ์˜3(๊ธฐ๊ด€์ƒ๋ช…์œค๋ฆฌ์œ„์›ํšŒ) โ‘ ใ€Œ์•„์ฃผ๋Œ€ํ•™๊ต ์ง์ œ๊ทœ์ •ใ€์ œ5์กฐ ์ œ10ํ•ญ์— ์˜๊ฑฐ ํŠน๋ณ„๊ธฐ๊ตฌ๋กœ ๊ธฐ๊ด€์ƒ๋ช…์œค๋ฆฌ์œ„์›ํšŒ๋ฅผ ๋‘”๋‹ค. (์‹ ์„ค 2013.7.30) (๊ฐœ์ • 2017.7.14)
   โ‘ก ๊ธฐ๊ด€์ƒ๋ช…์œค๋ฆฌ์œ„์›ํšŒ๋Š” ์ธ๊ฐ„๋Œ€์ƒ์—ฐ๊ตฌ ๋ฐ ์ธ์ฒด์œ ๋ž˜๋ฌผ์—ฐ๊ตฌ์˜ ์œค๋ฆฌ์™€ ์•ˆ์ „์„ ์‹ฌ์˜ํ•˜๊ณ  ๊ฐ๋…ํ•˜๋Š” ์—…๋ฌด๋ฅผ ๊ด€ํ• ํ•œ๋‹ค. (์‹ ์„ค 2013.7.30)
   โ‘ข ๊ธฐ๊ด€์ƒ๋ช…์œค๋ฆฌ์œ„์›ํšŒ ์šด์˜์— ๋Œ€ํ•ด์„œ๋Š” ์ด์žฅ์ด ๋”ฐ๋กœ ์ •ํ•œ๋‹ค. (์‹ ์„ค 2013.7.30)"""

Question generation test

{
  "topic": "๋Œ€ํ•™์›๊ณผ์ •",
  "question": "๋Œ€ํ•™์›๊ณผ์ •์— ๋Œ€ํ•ด ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "๋Œ€ํ•™์›๊ณผ์ •์ด๋ž€ ๋ฌด์—‡์ธ๊ฐ€์š”?",
    "๋Œ€ํ•™์›๊ณผ์ •๊ณผ ์ผ๋ฐ˜๋Œ€ํ•™์›์— ์–ด๋–ค ์ฐจ์ด์ ์ด ์žˆ๋Š”์ง€ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "๋Œ€ํ•™์›๊ณผ์ •์ด ํ•™๋ถ€์ƒ์˜ ํ•™์Šต๊ณผ ํ•™๋ฌธ์  ์„ฑ์žฅ์„ ์–ด๋–ป๊ฒŒ ์ง€์›ํ•˜๋Š”์ง€ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "ํ•™์‚ฌ๊ณผ์ •",
  "question": "ํ•™์‚ฌ๊ณผ์ •์˜ ๊ณผ์ •์— ๋Œ€ํ•ด ์ž์„ธํžˆ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "ํ•™์‚ฌ๊ณผ์ •์ด๋ž€ ๋ฌด์—‡์ด๋ฉฐ, ์ด ๊ณผ์ •์—์„œ ์–ด๋–ค ์ข…๋ฅ˜์˜ ํ•™์œ„๋ฅผ ์–ป์„ ์ˆ˜ ์žˆ๋Š”์ง€ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "ํ•™์‚ฌ๊ณผ์ •๊ณผ ์„ใ†๋ฐ•์‚ฌํ†ตํ•ฉ๊ณผ์ •์˜ ์ฐจ์ด์ ์— ๋Œ€ํ•ด ๋น„๊ตํ•˜๊ณ , ๊ฐ๊ฐ์˜ ๋ชฉ์ ๊ณผ ์—ญํ• ์— ๋Œ€ํ•ด ๋…ผํ•ด์ฃผ์„ธ์š”.",
    "ํ•™์‚ฌ๊ณผ์ •๊ณผ ๋Œ€ํ•™์›๊ณผ์ •์˜ ๊ด€๊ณ„์™€ ์ƒํ˜ธ์ž‘์šฉ์— ๋Œ€ํ•ด ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "๊ต์œก",
  "question": "์•„์ฃผ๋Œ€ํ•™๊ต์˜ ๋Œ€ํ•™์›๊ณผ์ •์€ ์–ด๋–ค ์ข…๋ฅ˜๊ฐ€ ์žˆ์œผ๋ฉฐ, ๊ฐ ๊ณผ์ •์˜ ํŠน์ง•์€ ๋ฌด์—‡์ธ๊ฐ€์š”?",
  "hard_questions": [
    "์•„์ฃผ๋Œ€ํ•™๊ต์˜ ๋Œ€ํ•™์›๊ณผ์ •์ด ์ •์˜๋˜๋Š” ๋ฐ”์— ๋Œ€ํ•ด ์ž์„ธํžˆ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์„์‚ฌ๊ณผ์ •, ๋ฐ•์‚ฌ๊ณผ์ •, ์„ใ†๋ฐ•์‚ฌํ†ตํ•ฉ๊ณผ์ •์˜ ์ฐจ์ด์ ์„ ๋น„๊ตํ•˜๊ณ , ๊ฐ ๊ณผ์ •์˜ ๋ชฉ์ ์— ๋Œ€ํ•ด ๋…ผํ•˜์„ธ์š”.",
    "ํ•™์‚ฌ๊ณผ์ •๊ณผ ์„ใ†๋ฐ•์‚ฌํ†ตํ•ฉ๊ณผ์ •์˜ ์—ฐ๊ณ„๊ณผ์ •์— ๋Œ€ํ•ด ์„ค๋ช…ํ•˜๊ณ , ์ด์— ๋Œ€ํ•œ ์žฅ๋‹จ์ ์— ๋Œ€ํ•ด ์„œ์ˆ ํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "๋Œ€ํ•™์˜ ๊ตฌ์„ฑ",
  "question": "์•„์ฃผ๋Œ€ํ•™๊ต์˜ ๋Œ€ํ•™ ๊ตฌ์„ฑ์›์€ ์–ด๋–ค ์กฐ์ง์ด ์žˆ์œผ๋ฉฐ, ๊ฐ ์กฐ์ง์˜ ์—ญํ• ์€ ๋ฌด์—‡์ธ๊ฐ€์š”?",
  "hard_questions": [
    "์•„์ฃผ๋Œ€ํ•™๊ต์˜ ์ด์žฅ์€ ๊ต๋ฌด์™€ ๋Œ€ํ•™๊ต๋ฅผ ๋Œ€ํ‘œํ•˜๋Š” ์—ญํ• ์„ ๋งก๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. ์ด์žฅ์˜ ๊ถŒํ•œ๊ณผ ์ฑ…์ž„์€ ์–ด๋–ค ๊ฒƒ๋“ค์ด ์žˆ๋Š”์ง€ ์ƒ์„ธํžˆ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์•„์ฃผ๋Œ€ํ•™๊ต์˜ ๋Œ€ํ•™์›๊ณผ์ •์€ ์–ด๋–ค ์ข…๋ฅ˜๊ฐ€ ์žˆ์œผ๋ฉฐ, ๊ฐ ๋Œ€ํ•™์›๊ณผ์ •์˜ ๋ชฉ์ ๊ณผ ๋‚ด์šฉ์€ ๋ฌด์—‡์ธ๊ฐ€์š”? ์ด๋Ÿฌํ•œ ๋Œ€ํ•™์›๊ณผ์ •์ด ๋Œ€ํ•™์˜ ๊ต์œก ์—ฐ๊ตฌ ๊ธฐ๋Šฅ์— ๋ฏธ์น˜๋Š” ์˜ํ–ฅ์€ ์–ด๋–ค ์ ์ด ์žˆ๋Š”์ง€ ๋ถ„์„ํ•ด์ฃผ์„ธ์š”.",
    "์•„์ฃผ๋Œ€ํ•™๊ต์˜ ๊ธฐ๊ตฌ ์ค‘์— ํŠน๋ณ„๊ธฐ๊ตฌ๋กœ ์„ค์น˜๋œ ํ‰์ƒํ•™์Šต์ค‘์‹ฌ๋Œ€ํ•™์ถ”์ง„๋ณธ๋ถ€์™€ ๊ธฐ๊ด€์ƒ๋ช…์œค๋ฆฌ์œ„์›ํšŒ์— ๋Œ€ํ•ด ์ž์„ธํžˆ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”. ์ด๋Ÿฌํ•œ ํŠน๋ณ„๊ธฐ๊ตฌ๊ฐ€ ๋Œ€ํ•™์˜ ๊ต์œก ์—ฐ๊ตฌ ๊ธฐ๋Šฅ์— ๋ฏธ์น˜๋Š” ์˜ํ–ฅ์€ ์–ด๋–ค ์ ์ด ์žˆ๋Š”์ง€ ๋ถ„์„ํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "๋ฒ•",
  "question": "์•„์ฃผ๋Œ€ํ•™๊ต์˜ ์ด์žฅ ์ง๋ฌด์— ๊ด€ํ•˜์—ฌ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "์•„์ฃผ๋Œ€ํ•™๊ต์˜ ์ด์žฅ์ด ๊ต์œก๊ณผ ๋Œ€ํ•™์˜ ๋Œ€ํ‘œ์ž๋กœ์„œ ์–ด๋–ค ์—ญํ• ์„ ์ˆ˜ํ–‰ํ•˜๋‚˜์š”? ๊ฐ ๋ถ€์ด์žฅ์˜ ์—ญํ• ์„ ์ž์„ธํžˆ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์•„์ฃผ๋Œ€ํ•™๊ต์˜ ๋ถ€์ด์žฅ๋“ค์€ ์ด์žฅ์—๊ฒŒ ์–ด๋– ํ•œ ์—…๋ฌด๋ฅผ ๊ด€์žฅํ•˜๊ณ  ์žˆ์„๊นŒ์š”? ๊ฐ ๋ถ€์ด์žฅ์ด ์–ด๋–ค ์ƒํ™ฉ์—์„œ ์ด์žฅ์„ ๋Œ€ํ–‰ํ•  ์ˆ˜ ์žˆ๋Š”์ง€ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์•„์ฃผ๋Œ€ํ•™๊ต์˜ ๋Œ€ํ•™๊ต๋ณธ๋ถ€์— ์–ด๋–ค ์ฒ˜๋“ค์ด ์„ค์น˜๋˜์–ด ์žˆ์œผ๋ฉฐ, ๊ฐ ์ฒ˜์˜ ์—…๋ฌด์— ๊ด€ํ•˜์—ฌใ€Œ์•„์ฃผ๋Œ€ํ•™๊ต ์ง์ œ๊ทœ์ •ใ€์ด ์ •ํ•˜๊ณ  ์žˆ๋‚˜์š”?"
  ]
}

Writing generation test

{
  "topic": "๋ฐœํ‘œ์ž๋ฃŒ ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "์•„์ฃผ๋Œ€ํ•™๊ต์˜ ๊ธฐ๊ตฌ์™€ ์ง์ œ ๊ทœ์ •์— ๋Œ€ํ•ด ๋ฐœํ‘œ์ž๋ฃŒ๋ฅผ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "๋Œ€ํ•™๊ต์— ์„ค์น˜๋œ ๊ธฐ๊ตฌ๋“ค์˜ ์—ญํ• ๊ณผ ์œ„์น˜์— ๋Œ€ํ•ด ์ž์„ธํžˆ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "ํ‰์ƒํ•™์Šต์ค‘์‹ฌ๋Œ€ํ•™์ถ”์ง„๋ณธ๋ถ€์™€ ๊ธฐ๊ด€์ƒ๋ช…์œค๋ฆฌ์œ„์›ํšŒ์˜ ์—…๋ฌด์— ๋Œ€ํ•ด ์„œ์ˆ ํ•ด์ฃผ์„ธ์š”.",
    "์ด์žฅ๊ณผ ๋ถ€์ด์žฅ์˜ ์—ญํ•  ๋ฐ ์ž„๋ช… ๊ณผ์ •์— ๋Œ€ํ•ด ์กฐ์‚ฌํ•˜์—ฌ ๋ฐœํ‘œ์ž๋ฃŒ๋ฅผ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "์ด๋ฉ”์ผ ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "์•„์ฃผ๋Œ€ํ•™๊ต์— ๋Œ€ํ•œ ํ•™๋ถ€๋ชจ์—๊ฒŒ ์ด๋ฉ”์ผ์„ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "์ด๋ฉ”์ผ์—์„œ ์–ด๋–ค ์ •๋ณด๊ฐ€ ํฌํ•จ๋˜์–ด์•ผ ํ• ๊นŒ์š”?",
    "์•„์ฃผ๋Œ€ํ•™๊ต์˜ ํ•™๋ถ€๋ชจ์—๊ฒŒ ์ „๋‹ฌํ•  ์ค‘์š”ํ•œ ์‚ฌํ•ญ์€ ๋ฌด์—‡์ผ๊นŒ์š”?",
    "์ด๋ฉ”์ผ ์ž‘์„ฑ์‹œ ์ฃผ์˜ํ•ด์•ผ ํ•  ์ ์€ ๋ฌด์—‡์ธ๊ฐ€์š”?"
  ]
}
{
  "topic": "๋ถ„์„๋ณด๊ณ ์„œ ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "์•„์ฃผ๋Œ€ํ•™๊ต ํ•™์น™ ์ œ3์กฐ์—์„œ ์–ธ๊ธ‰๋œ ๋Œ€ํ•™์›๊ณผ์ •, ํ•™์—ฐ์‚ฐํ˜‘๋™๊ณผ์ •, ํ•™ใ†์„์‚ฌ์—ฐ๊ณ„๊ณผ์ • ๋“ฑ์— ๋Œ€ํ•ด ๋ถ„์„ ๋ณด๊ณ ์„œ๋ฅผ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "๋Œ€ํ•™์›๊ณผ์ •๊ณผ ํ•™ใ†์„์‚ฌ์—ฐ๊ณ„๊ณผ์ •์˜ ์ฐจ์ด์ ๊ณผ ์—ฐ๊ณ„๊ณผ์ •์ด ์™œ ์ค‘์š”ํ•œ์ง€ ๋ถ„์„ํ•ด๋ณด์„ธ์š”.",
    "ํ•™ใ†์„์‚ฌ์—ฐ๊ณ„๊ณผ์ •์˜ ์žฅ์ ๊ณผ ๋‹จ์ ์„ ๋น„๊ต ๋ถ„์„ํ•˜๊ณ  ๊ฐœ์„ ์ ์„ ์ œ์‹œํ•ด๋ณด์„ธ์š”.",
    "์•„์ฃผ๋Œ€ํ•™๊ต ๋Œ€ํ•™์›๊ณผ์ •์˜ ํŠน์„ฑ๊ณผ ํ•™ใ†์„์‚ฌ์—ฐ๊ณ„๊ณผ์ •์˜ ์ค‘์š”์„ฑ์— ๋Œ€ํ•ด ์„œ์ˆ ํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "์ž๊ธฐ์†Œ๊ฐœ์„œ ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "์•„์ฃผ๋Œ€ํ•™๊ต์˜ ํ•™์น™์„ ๋ณด๊ณ , ํ•ด๋‹น ๋Œ€ํ•™๊ต๊ฐ€ ๋ชฉํ‘œ๋กœ ํ•˜๋Š” ๊ต์œก ๋ชฉํ‘œ๋ฅผ ์–ด๋–ค ์ข…๋ฅ˜์˜ ์ธ๊ฐ„์„ ์–‘์„ฑํ•˜๋Š”์ง€ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "๋Œ€ํ•™์ด๋…์— ๋”ฐ๋ผ ๋Œ€ํ•™์—์„œ ๊ต์œก ๋ฐ ์—ฐ๊ตฌ์˜ ์ค‘์š”์„ฑ์€ ๋ฌด์—‡์ธ๊ฐ€์š”?",
    "ํ•™์ƒ๋“ค ๊ฐ„์˜ ํ˜‘๋™๊ณผ ์‚ฌํšŒ์  ์ฑ…์ž„์„ ๊ฐ•์กฐํ•˜๋Š” ์ด์œ ๋Š” ๋ฌด์—‡์ธ๊ฐ€์š”?",
    "๋Œ€ํ•™์˜ ํ•™๋ถ€ ๊ฐ„ ํ˜‘๋™ ๊ณผ์ •์—์„œ ์–ด๋–ค ํ˜‘๋ ฅ ์ฒด๊ณ„๊ฐ€ ์‚ฌ์šฉ๋˜๋Š”์ง€ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "์ด๋ฉ”์ผ ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "์•„์ฃผ๋Œ€ํ•™๊ต ํ•™์ƒ๋“ค์„ ๋Œ€์ƒ์œผ๋กœ ์ด๋ฉ”์ผ์„ ๋ณด๋‚ด๊ณ ์ž ํ•ฉ๋‹ˆ๋‹ค. ์ด๋ฉ”์ผ ์ œ๋ชฉ์€ ์–ด๋–ค ๊ฒƒ์ธ์ง€ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "์ด๋ฉ”์ผ์˜ ์ฃผ์ œ์™€ ๋‚ด์šฉ์„ ์ž์„ธํžˆ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์ด๋ฉ”์ผ์„ ํ†ตํ•ด ํ•™์ƒ๋“ค์—๊ฒŒ ์ „๋‹ฌํ•˜๊ณ  ์‹ถ์€ ๋ฉ”์‹œ์ง€๋Š” ๋ฌด์—‡์ธ๊ฐ€์š”?",
    "์ด๋ฉ”์ผ ๋‚ด์šฉ์—์„œ ์–ด๋–ค ์ค‘์š” ๋‚ด์šฉ์„ ๊ฐ•์กฐํ•ด์•ผ ํ• ๊นŒ์š”?"
  ]
}
์˜ˆ์‹œ 2: ๋‰ด์Šค

์ž…๋ ฅ

title = "ํ”„๋ž‘์Šค ์ด์„  ๋Œ€๋ฐ˜์ „โ€ฆ ์ขŒํŒŒ์—ฐํ•ฉ ์Šน๋ฆฌ"
text = """7์ผ(ํ˜„์ง€์‹œ๊ฐ„) ์น˜๋Ÿฌ์ง„ ํ”„๋ž‘์Šค ์กฐ๊ธฐ ์ด์„  ๊ฒฐ์„ ์—์„œ ์ขŒํŒŒ์—ฐํ•ฉ ์‹ ๋ฏผ์ค‘์ „์„ (NFP)์ด ์˜ˆ์ƒ์„ ๊นจ๊ณ  ๊ทน์šฐ ๊ตญ๋ฏผ์—ฐํ•ฉ(RN)์„ ๋ˆ„๋ฅด๊ณ  1๋‹น ์ž๋ฆฌ๋ฅผ ์ฐจ์ง€ํ–ˆ๋‹ค. 1์ฐจ ํˆฌํ‘œ์—์„œ 1์œ„๋ฅผ ์ฐจ์ง€ํ•˜๋ฉฐ ์ด์„  ๊ธฐ๊ฐ„ ๋‚ด๋‚ด ์ง€์ง€์œจ 1์œ„์˜€๋˜ RN์€ ๋ฒ”์—ฌ๊ถŒ๊ณผ ์ขŒํŒŒ์˜ ๋‹จ์ผํ™” ๋ฒฝ์— ๋ถ€๋”ชํ˜€ 3์œ„๋กœ ๋ฐ€๋ ค๋‚ฌ๋‹ค.

8์ผ ํ”„๋ž‘์Šค ๋‚ด๋ฌด๋ถ€์— ๋”ฐ๋ฅด๋ฉด ์ด์„  ๊ฒฐ์„  ํˆฌํ‘œ ๊ฒฐ๊ณผ, NFP๊ฐ€ ํ•˜์› 577์„ ์ค‘ 182์„์„ ์–ป์–ด ์›๋‚ด 1๋‹น ์ž๋ฆฌ์— ์˜ฌ๋ž๋‹ค. ์—๋งˆ๋‰˜์—˜ ๋งˆํฌ๋กฑ ๋Œ€ํ†ต๋ น์˜ ๋ฅด๋„ค์ƒ์Šค๋‹น์„ ์ค‘์‹ฌ์œผ๋กœ ํ•œ ์—ฌ๊ถŒ ์—ฐํ•ฉ ์•™์ƒ๋ธ”์€ 168์„์œผ๋กœ 2์œ„๋ฅผ ์ฐจ์ง€ํ–ˆ๋‹ค. RN์€ 143์„์„ ์–ป๋Š” ๋ฐ ๊ทธ์ณค๋‹ค.

RN์€ ์ง€๋‚œ๋‹ฌ 30์ผ 1์ฐจ ํˆฌํ‘œ์—์„œ 33.2%๋ฅผ ๋“ํ‘œํ•ด 1์œ„์— ์˜ค๋ฅด๋ฉด์„œ 2์ฐจ ๊ฒฐ์„ ํˆฌํ‘œ์—์„œ 240โˆผ270์„์„ ์–ป์„ ๊ฒƒ์œผ๋กœ ์ „๋ง๋๋‹ค. ํ•˜์ง€๋งŒ ๊ทน์šฐ ์ง‘๊ถŒ์„ ๋ง‰๊ธฐ ์œ„ํ•ด NFP์™€ ์•™์ƒ๋ธ”์ด ๋Œ€๋Œ€์ ์ธ ํ›„๋ณด ๋‹จ์ผํ™”์— ๋‚˜์„œ๋ฉด์„œ ํŒ์„ธ๊ฐ€ ๋’ค์ง‘ํ˜”๋‹ค. RN์˜ ์กฐ๋ฅด๋‹น ๋ฐ”๋ฅด๋ธ๋ผ ๋Œ€ํ‘œ๋Š” โ€œ๋ถˆ๋ช…์˜ˆ์Šค๋Ÿฌ์šด ๋™๋งน์ด ํ”„๋ž‘์Šค๋ฅผ ๊ทน์ขŒ์˜ ํ’ˆ์— ๋˜์ง€๊ณ  ์žˆ๋‹คโ€๋ฉฐ โ€œ์šฐ๋ฆฌ๋Š” ํ”„๋ž‘์Šค ๊ตญ๋ฏผ์˜ ํŽธ์— ์„ค ๊ฒƒโ€์ด๋ผ๊ณ  ํ•œ์ธต ๊ฐ•๊ฒฝํ•œ ๋Œ€์ •๋ถ€ ํˆฌ์Ÿ์„ ์˜ˆ๊ณ ํ–ˆ๋‹ค.

์ด์„  ๊ฒฐ๊ณผ ์›๋‚ด 1๋‹น์„ ์ฐจ์ง€ํ•˜๊ฒŒ ๋œ NFP๋Š” ์ •๋ถ€ ์šด์˜์— ๋‚˜์„ค ๋œป์„ ๋ถ„๋ช…ํžˆ ํ•ด 27๋…„ ๋งŒ์— ๋™๊ฑฐ์ •๋ถ€๊ฐ€ ๋“ค์–ด์„ค ๊ฒƒ์œผ๋กœ ๋ณด์ธ๋‹ค. NFP ์†Œ์†์ธ ๊ตด๋ณตํ•˜์ง€์•Š๋Š”ํ”„๋ž‘์Šค(LFI)์˜ ์žฅ๋คผํฌ ๋ฉœ๋ž‘์ˆ‘ ๋Œ€ํ‘œ๋Š” โ€œ์œ ๊ถŒ์ž๋“ค์ด ๋ถˆ๊ฐ€๋Šฅํ•  ๊ฒƒ์œผ๋กœ ์—ฌ๊ฒจ์ง„ ์ขŒํŒŒ์—ฐํ•ฉ์˜ ์Šน๋ฆฌ๋ฅผ ๋งŒ๋“ค์–ด๋ƒˆ๋‹คโ€๋ฉฐ โ€œ์ขŒํŒŒ์—ฐํ•ฉ์€ ์ง‘๊ถŒํ•  ์ค€๋น„๊ฐ€ ๋ผ ์žˆ๋‹คโ€๊ณ  ๋งํ–ˆ๋‹ค. NFP ์†Œ์† ์‚ฌํšŒ๋‹น์˜ ์˜ฌ๋ฆฌ๋น„์— ํฌ๋ฅด ๋Œ€ํ‘œ๋„ โ€œํ”„๋ž‘์Šค๋Š” RN์ด ์ง‘๊ถŒํ•˜๋Š” ๊ฒƒ์„ ๊ฑฐ๋ถ€ํ–ˆ๋‹คโ€๋ฉฐ โ€œNFP๊ฐ€ ์šฐ๋ฆฌ ์—ญ์‚ฌ์˜ ์ƒˆ๋กœ์šด ํŽ˜์ด์ง€๋ฅผ ์ฑ…์ž„์ ธ์•ผ ํ•œ๋‹คโ€๊ณ  ๊ฐ•์กฐํ–ˆ๋‹ค.

ํ•œํŽธ ๊ฐ€๋ธŒ๋ฆฌ์—˜ ์•„ํƒˆ ์ด๋ฆฌ๋Š” ์•™์ƒ๋ธ”์ด 1๋‹น ์ง€์œ„๋ฅผ ํ™•๋ณดํ•˜์ง€ ๋ชปํ•œ ๋ฐ ๋Œ€ํ•ด ์ฑ…์ž„์„ ์ง€๊ฒ ๋‹ค๋ฉฐ ๋Œ€ํ†ต๋ น์—๊ฒŒ ์‚ฌ์˜๋ฅผ ํ‘œํ•˜๊ฒ ๋‹ค๊ณ  ๋ฐํ˜”๋‹ค."""

Question generation test

{
  "topic": "ํ”„๋ž‘์Šค ์ •์น˜",
  "question": "ํ”„๋ž‘์Šค ์กฐ๊ธฐ ์ด์„  ๊ฒฐ๊ณผ์— ๋Œ€ํ•ด ๊ฐ„๋‹จํžˆ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "NFP์™€ RN ๊ฐ„์˜ ๊ฒฝ์Ÿ์ด ์–ด๋–ป๊ฒŒ ์ „๊ฐœ๋˜์—ˆ๋Š”์ง€ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "NFP๊ฐ€ ์ •๋ถ€ ์šด์˜์— ๋‚˜์„ค ๋œป์„ ๋ฐํžŒ ์ด์œ ์™€ ์ด๋กœ ์ธํ•ด ๋ฐœ์ƒํ•˜๋Š” ๋ณ€ํ™”์— ๋Œ€ํ•ด ๋ถ„์„ํ•ด์ฃผ์„ธ์š”.",
    "์ด์„  ๊ฒฐ๊ณผ๋กœ ์ธํ•ด ๋ฐœ์ƒํ•˜๋Š” ํ”„๋ž‘์Šค ์ •์น˜์˜ ์ „๋ง๊ณผ ์ฃผ์š” ์ธ๋ฌผ๋“ค์˜ ์—ญํ• ์— ๋Œ€ํ•ด ๋…ผํ•˜์„ธ์š”."
  ]
}
{
  "topic": "ํ”„๋ž‘์Šค ์ •์น˜",
  "question": "์ด์„  ๊ฒฐ๊ณผ์— ๋Œ€ํ•œ ๊ฐ„๋žตํ•œ ์„ค๋ช…์„ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "์ด์„ ์—์„œ ์ขŒํŒŒ์—ฐํ•ฉ์˜ ์Šน๋ฆฌ๊ฐ€ ๊ทน์šฐ ์ •๋‹น์— ์–ด๋–ค ์˜ํ–ฅ์„ ๋ฏธ์ณค๋Š”์ง€ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์ด์ „์˜ ํ”„๋ž‘์Šค ์ด์„  ๊ฒฐ๊ณผ์™€ ํ˜„์žฌ์˜ ์ด์„  ๊ฒฐ๊ณผ ๊ฐ„์˜ ์ฐจ์ด์ ์€ ๋ฌด์—‡์ธ๊ฐ€์š”?",
    "์—ฌ๊ถŒ ์—ฐํ•ฉ ์•™์ƒ๋ธ”์ด ์ง€์ง€์œจ 2์œ„๋กœ ์ž๋ฆฌํ–ˆ์Œ์—๋„, ์™œ ์—ฌ์ „ํžˆ ๊ถŒ๋ ฅ์ด ๋ถ€์—ฌ๋˜๋Š”์ง€์— ๋Œ€ํ•ด ์ƒ๊ฐํ•ด๋ณด๊ณ  ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "์‚ฌํšŒ๊ณผํ•™",
  "question": "ํ•œ๊ตญ์˜ ์ด์„  ๊ฒฐ๊ณผ์™€ ํ”„๋ž‘์Šค์˜ ์ด์„  ๊ฒฐ๊ณผ๋ฅผ ๋น„๊ตํ•˜์—ฌ ์ •์น˜์  ์„ฑํ–ฅ๊ณผ ๋“ํ‘œ์œจ์— ๋Œ€ํ•ด ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "ํ•œ๊ตญ๊ณผ ํ”„๋ž‘์Šค์˜ ์ด์„  ๊ฒฐ๊ณผ๋ฅผ ์ข…ํ•ฉํ•˜์—ฌ ๊ฐ ๊ตญ๊ฐ€์˜ ์ •์น˜์ฒด์ œ์™€ ๊ตญ๋ฏผ๋“ค์˜ ์ •์น˜์  ์˜์‹์— ๋Œ€ํ•ด ๋ถ„์„ํ•ด๋ณด์„ธ์š”.",
    "ํ•œ๊ตญ๊ณผ ํ”„๋ž‘์Šค์˜ ์ •๋‹น ๊ฐ„์˜ ์—ฐํ•ฉ๊ณผ ์—ฐ๋Œ€ ๊ด€๊ณ„๋ฅผ ๋น„๊ตํ•˜๊ณ , ์ด์— ๋Œ€ํ•œ ์ •์น˜์  ์˜๋ฏธ๋ฅผ ๋…ผํ•ด์ฃผ์„ธ์š”.",
    "ํ•œ๊ตญ๊ณผ ํ”„๋ž‘์Šค์˜ ์ •์น˜์ฒด์ œ๊ฐ€ ๊ฐ–๋Š” ๊ตญ์ œ ์ •์น˜์  ์˜ํ–ฅ๋ ฅ์„ ๋น„๊ตํ•˜๊ณ , ์ด์— ๋Œ€ํ•œ ์˜ˆ์ธก์„ ํ•ด๋ณด์„ธ์š”."
  ]
}
{
  "topic": "์ •์น˜",
  "question": "์ขŒํŒŒ์—ฐํ•ฉ์ด ํ”„๋ž‘์Šค ์ด์„ ์—์„œ ์–ด๋–ป๊ฒŒ ์Šน๋ฆฌํ•˜์˜€๋Š”์ง€ ์ž์„ธํžˆ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "์ขŒํŒŒ์—ฐํ•ฉ์˜ ์Šน๋ฆฌ๊ฐ€ ์›๋‚ด 1๋‹น ์ž๋ฆฌ๋ฅผ ์ฐจ์ง€ํ•˜๊ฒŒ ๋œ ๊ณผ์ •์„ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "๊ทน์šฐ ๊ตญ๋ฏผ์—ฐํ•ฉ(RN)๊ณผ ์ขŒํŒŒ์—ฐํ•ฉ(NFP)์˜ ์„ ๊ฑฐ ์ „๋žต๊ณผ ๊ฒฐ๊ณผ์— ๋Œ€ํ•ด ๋น„๊ต ๋ถ„์„ํ•ด์ฃผ์„ธ์š”.",
    "NFP๊ฐ€ ์ขŒํŒŒ์—ฐํ•ฉ์œผ๋กœ ์ง‘๊ถŒํ•  ์ค€๋น„๊ฐ€ ๋ผ ์žˆ๋‹ค๊ณ  ์ฃผ์žฅํ•œ ์ด์œ ๋ฅผ ์ƒ์„ธํžˆ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "๋ฒ•",
  "question": "์ด์„  ๊ฒฐ๊ณผ์— ๋”ฐ๋ผ ์ผ์–ด๋‚  ์ˆ˜ ์žˆ๋Š” ์ •์ฑ… ๋ณ€ํ™”์— ๋Œ€ํ•ด ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "์ด์„  ๊ฒฐ๊ณผ๊ฐ€ ํ”„๋ž‘์Šค ์ •์น˜์— ๋ฏธ์น  ์˜ํ–ฅ์„ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์ด๋ฒˆ ์ด์„  ๊ฒฐ๊ณผ๊ฐ€ ํ”„๋ž‘์Šค ์ •์น˜์ฒด์ œ์— ๋ฏธ์น  ์˜ํ–ฅ์„ ๋ถ„์„ํ•ด์ฃผ์„ธ์š”.",
    "์ด์„  ๊ฒฐ๊ณผ์— ๋”ฐ๋ผ ์˜ˆ์ƒ๋˜๋Š” ์ •์ฑ… ๋ณ€ํ™”๊ฐ€ ํ”„๋ž‘์Šค ์‚ฌํšŒ์— ๋ฏธ์น  ์˜ํ–ฅ์„ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”."
  ]
}

Writing generation test

{
  "topic": "์ผ๊ธฐ ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "๋‹น์‹ ์ด ์˜ค๋Š˜ ์ฝ์€ ํ”„๋ž‘์Šค ์ด์„  ๋Œ€๋ฐ˜์ „๊ณผ ์ขŒํŒŒ์—ฐํ•ฉ์˜ ์Šน๋ฆฌ ์†Œ์‹์„ ์ฝ๊ณ , ํ•˜๋ฃจ ๋™์•ˆ ๋Š๋‚€ ๊ฐ์ •์„ ์จ๋ณด์„ธ์š”.",
  "hard_questions": [
    "์ด ์†Œ์‹์ด ๋‹น์‹ ์—๊ฒŒ ๋ฏธ์น˜๋Š” ์˜ํ–ฅ์„ ์„ค๋ช…ํ•ด๋ณด์„ธ์š”.",
    "์ด ์†Œ์‹์„ ์ฝ๊ณ  ๋‚œ ํ›„ ๊ฐ€์žฅ ์ค‘์š”ํ•œ ๊ฒƒ์€ ๋ฌด์—‡์ธ๊ฐ€์š”?",
    "๋‹น์‹ ์ด ์ด ์†Œ์‹์„ ์ฝ๊ณ  ๋‚œ ํ›„ ์–ด๋–ป๊ฒŒ ํ–‰๋™ํ•  ๊ฒƒ์ด๋ฉฐ, ๊ทธ ์ด์œ ๋Š” ๋ฌด์—‡์ธ๊ฐ€์š”?"
  ]
}
{
  "topic": "๋ถ„์„๋ณด๊ณ ์„œ ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "ํ”„๋ž‘์Šค ์ด์„  ๊ฒฐ๊ณผ์— ๋Œ€ํ•œ ๋ถ„์„๋ณด๊ณ ์„œ๋ฅผ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "NFP๊ฐ€ ์›๋‚ด 1๋‹น์„ ์ฐจ์ง€ํ•˜๊ฒŒ ๋œ ์ด์œ ์— ๋Œ€ํ•ด ๋ถ„์„ํ•˜๊ณ , RN์ด 3์œ„๋กœ ๋ฐ€๋ฆฐ ์›์ธ์— ๋Œ€ํ•ด ์ƒ์„ธํžˆ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”.",
    "์ขŒํŒŒ์—ฐํ•ฉ์ด ์ •๋ถ€ ์šด์˜์— ๋‚˜์„ค ๋œป์„ ๋ถ„๋ช…ํžˆ ํ•œ ๊ฒฝ์šฐ์— ๋Œ€ํ•œ ๋ถ„์„ ๋ฐ ์‹œ์‚ฌ์ ์„ ์ œ์‹œํ•ด์ฃผ์„ธ์š”.",
    "์ „์ฒด ๋ถ„์„์„ ํ†ตํ•ด ์ด ์ด์„ ์ด ํ”„๋ž‘์Šค ์ •์น˜์— ๋ฏธ์น  ์˜ํ–ฅ๊ณผ ํ–ฅํ›„ ์ „๋ง์— ๋Œ€ํ•ด ๋…ผ์˜ํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "ํ•ด์„ค ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "์ด์„  ๊ฒฐ๊ณผ๋ฅผ ํ•ด์„คํ•ด๋ณด์„ธ์š”.",
  "hard_questions": [
    "NFP์™€ ์•™์ƒ๋ธ”์˜ ์„ ๊ฑฐ ๊ฒฐ๊ณผ๋ฅผ ํ•ด์„คํ•˜๋ฉด์„œ ๊ฐ ํ›„๋ณด๋“ค์ด ์–ด๋–ค ์ ์„ ๊ฐ•์กฐํ•˜์˜€๋Š”์ง€ ์ž์„ธํžˆ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”.",
    "์ •์น˜ํ•™์ ์ธ ๊ด€์ ์—์„œ ํ•ด์„ํ•œ ๋ฐ”๋ฅผ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์ด์„  ๊ฒฐ๊ณผ๊ฐ€ ํ”„๋ž‘์Šค ์‚ฌํšŒ์— ๋ฏธ์น  ์˜ํ–ฅ๊ณผ ๊ฐ€๋Šฅ์„ฑ์„ ์ „๋งํ•ด๋ณด์„ธ์š”."
  ]
}
{
  "topic": "์ž๊ธฐ์†Œ๊ฐœ์„œ ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "๋‹น์‹ ์€ ์ด์„  ๊ฒฐ๊ณผ๋ฅผ ์†Œํ†ตํ•  ํ•„์š”๊ฐ€ ์žˆ๋‹ค๊ณ  ์ƒ๊ฐํ•˜๋Š” ํ”„๋ž‘์Šค ์ •์น˜์ธ์œผ๋กœ, ์ž๊ธฐ์†Œ๊ฐœ์„œ๋ฅผ ์ž‘์„ฑํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. ์ด์— ๋”ฐ๋ผ, ๋‹น์‹ ์˜ ์ •์น˜์  ๊ฐ€์น˜๊ด€๊ณผ ์ „๋žต์„ ์„ค๋ช…ํ•˜๊ณ , ํ”„๋ž‘์Šค ๊ตญ๋ฏผ์—๊ฒŒ ์–ด๋–ค ๋ฉ”์‹œ์ง€๋ฅผ ์ „๋‹ฌํ•  ๊ฒƒ์ธ์ง€ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "์ž๊ธฐ์†Œ๊ฐœ์„œ๋ฅผ ์ž‘์„ฑํ•  ๋•Œ, ๋‹น์‹ ์˜ ์ •์น˜์  ๊ฐ€์น˜๊ด€์„ ๊ฐ•์กฐํ•˜๊ณ , ์ด๋ฅผ ํ”„๋ž‘์Šค ๊ตญ๋ฏผ์—๊ฒŒ ์ „๋‹ฌํ•˜๋Š” ๋ฐฉ๋ฒ•์— ๋Œ€ํ•ด ์–ด๋–ป๊ฒŒ ์ƒ๊ฐํ•˜์‹œ๋Š”์ง€ ์“ฐ์„ธ์š”.",
    "์ž๊ธฐ์†Œ๊ฐœ์„œ ์ž‘์„ฑ ์ค‘ ์ž์‹ ์„ ๋Œ€ํ‘œํ•  ์ˆ˜ ์žˆ๋Š” ๊ฒฝํ—˜์„ ๋ช‡ ๊ฐ€์ง€ ์†Œ๊ฐœํ•˜๊ณ , ์ด๋ฅผ ํ†ตํ•ด ๋ณด์—ฌ์ฃผ๋Š” ๋‹น์‹ ์˜ ์„ฑ์žฅ๊ณผ ๊ฒฝํ—˜์„ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "๋‹น์‹ ์˜ ์ •์น˜์  ์ „๋žต์„ ๊ฐ„๋‹จํžˆ ์„ค๋ช…ํ•˜๊ณ , ์ด๋ฅผ ํ†ตํ•ด ํ”„๋ž‘์Šค ๊ตญ๋ฏผ์—๊ฒŒ ์–ด๋– ํ•œ ๋ฉ”์‹œ์ง€๋ฅผ ์ „๋‹ฌํ•  ๊ฒƒ์ธ์ง€ ์„œ์ˆ ํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "์ด๋ ฅ์„œ ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "๋‹น์‹ ์ด ์ด๋ ฅ์„œ๋ฅผ ์ž‘์„ฑํ•ด์•ผ ํ•œ๋‹ค. ์–ด๋–ค ๋‚ด์šฉ์„ ๋ฐ˜๋“œ์‹œ ํฌํ•จํ•ด์•ผ ํ•˜๋ฉฐ, ๊ทธ ์ด์œ ๋Š” ๋ฌด์—‡์ธ๊ฐ€์š”?",
  "hard_questions": [
    "์ด๋ ฅ์„œ๋ฅผ ์ž‘์„ฑํ•  ๋•Œ ์ค‘์š”ํ•œ ์ ์€ ๋ฌด์—‡์ด๋ฉฐ, ์™œ ์ค‘์š”ํ•œ๊ฐ€์š”?",
    "์ž๊ธฐ์†Œ๊ฐœ์„œ ์ž‘์„ฑ ์‹œ ์ฃผ์˜ํ•ด์•ผ ํ•  ์ ์€ ๋ฌด์—‡์ธ๊ฐ€์š”?",
    "์ด๋ ฅ์„œ ์ž‘์„ฑ ์‹œ ๊ฐ•์กฐํ•ด์•ผ ํ•  ๋‚ด์šฉ๊ณผ ๊ธฐ์ˆ ์ ์ธ ์ธก๋ฉด์€ ๋ฌด์—‡์ธ๊ฐ€์š”?"
  ]
}
์˜ˆ์‹œ 3: ๋ฒ•๋ฅ  ํŒ๋ก€

์ž…๋ ฅ

title = "๊ฐ์—ผ๋ณ‘์˜์˜ˆ๋ฐฉ๋ฐ๊ด€๋ฆฌ์—๊ด€ํ•œ๋ฒ•๋ฅ ์œ„๋ฐ˜"
text = "์งˆ๋ณ‘๊ด€๋ฆฌ์ฒญ์žฅ, ์‹œยท๋„์ง€์‚ฌ ๋˜๋Š” ์‹œ์žฅยท๊ตฐ์ˆ˜ยท๊ตฌ์ฒญ์žฅ์€ ๊ฐ์—ผ๋ณ‘์˜ ์ „ํŒŒ ๋ฐฉ์ง€ ๋ฐ ์˜ˆ๋ฐฉ์„ ์œ„ํ•˜์—ฌ ๊ฐ์—ผ๋ณ‘์˜์‹ฌ์ž์—๊ฒŒ ์ž๊ฐ€ ๋˜๋Š” ์‹œ์„ค์— ๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ํ•˜๊ฒŒ ํ•  ์ˆ˜ ์žˆ๊ณ , ๋ˆ„๊ตฌ๋“ ์ง€ ์œ„์™€ ๊ฐ™์€ ๊ฒฉ๋ฆฌ์กฐ์น˜๋ฅผ ์œ„๋ฐ˜ํ•˜์—ฌ์„œ๋Š” ์•„๋‹ˆ ๋œ๋‹ค. ํ”ผ๊ณ ์ธ์€ ์ฝ”๋กœ๋‚˜19 ํ™•์ง„์ž์™€ ์ ‘์ด‰ํ•œ ๊ฒฉ๋ฆฌ๋Œ€์ƒ์ž๋กœ โ€˜2021. 2. 25.๋ถ€ํ„ฐ 2021. 3. 10.๊นŒ์ง€ ๊ด‘์ฃผ ๋ถ๊ตฌ B๊ฑด๋ฌผ, Cํ˜ธ์— ์ž๊ฐ€๊ฒฉ๋ฆฌ ์กฐ์น˜ํ•œ๋‹ค'๋Š” ๋‚ด์šฉ์˜ ๊ฒฉ๋ฆฌํ†ต์ง€์„œ๋ฅผ ์ˆ˜๋ นํ•˜์˜€์Œ์—๋„ ๋ถˆ๊ตฌํ•˜๊ณ , ๊ฒฉ๋ฆฌ๊ธฐ๊ฐ„ ์ค‘์ธ 2021. 3. 10. 10:00๊ฒฝ๋ถ€ํ„ฐ ๊ฐ™์€ ๋‚  11:30๊ฒฝ๊นŒ์ง€ ํ”ผ๊ณ ์ธ์˜ ์ž๊ฐ€๊ฒฉ๋ฆฌ ์‚ฌ์‹ค์„ ๋ชจ๋ฅด๋Š” ์‚ฌ์—… ๊ด€๊ณ„์ž๋ฅผ ๋งŒ๋‚˜๊ธฐ ์œ„ํ•˜์—ฌ ํ”ผ๊ณ ์ธ์˜ ํœด๋Œ€์ „ํ™”์— ์„ค์น˜๋œ ์ž๊ฐ€๊ฒฉ๋ฆฌ ์•ˆ์ „๋ณดํ˜ธ ์•ฑ์„ ๋„๊ณ  ์œ„ ์žฅ์†Œ์—์„œ ์ดํƒˆํ•˜์—ฌ ์ž์ฐจ๋กœ ์ „๋ถ ๋‚จ์›๊นŒ์ง€ ์šด์ „ํ•˜๋Š” ๋“ฑ ์ž๊ฐ€๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ์œ„๋ฐ˜ํ•˜์˜€๋‹ค."

Question generation test

{
  "topic": "๊ฐ์—ผ๋ณ‘ ์˜ˆ๋ฐฉ ๋ฐ ๊ด€๋ฆฌ",
  "question": "์œ„ ์ž๋ฃŒ์— ๋”ฐ๋ฅด๋ฉด, ๊ฐ์—ผ๋ณ‘์˜ ์ „ํŒŒ ๋ฐฉ์ง€ ๋ฐ ์˜ˆ๋ฐฉ์„ ์œ„ํ•ด ๊ฐ์—ผ๋ณ‘์˜์‹ฌ์ž์—๊ฒŒ ๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ํ•˜๊ฒŒ ํ•œ๋‹ค๋Š” ๋ฒ•๋ฅ  ๋‚ด์šฉ์€ ๋ฌด์—‡์ธ๊ฐ€์š”?",
  "hard_questions": [
    "์œ„ ์ž๋ฃŒ์—์„œ ๋งํ•˜๋Š” '์ž๊ฐ€ ๋˜๋Š” ์‹œ์„ค์— ๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ํ•˜๊ฒŒ ํ•  ์ˆ˜ ์žˆ๋‹ค'๋ผ๋Š” ๋ถ€๋ถ„์€ ์–ด๋–ค ์˜๋ฏธ๋ฅผ ๋‹ด๊ณ  ์žˆ๋‚˜์š”?",
    "ํ”ผ๊ณ ์ธ์ด ๋ฐ›์€ ๊ฒฉ๋ฆฌํ†ต์ง€์„œ์˜ ๋‚ด์šฉ์€ ์–ด๋–ค ๋‚ด์šฉ์ด๋ฉฐ, ์™œ ์œ„์—์„œ ์–ธ๊ธ‰๋œ ๋Œ€๋กœ ํ–‰๋™์„ ํ•œ ๊ฒƒ์ด ๋ฌธ์ œ์ผ๊นŒ์š”?",
    "์œ„ ๋ฒ•๋ฅ  ๋‚ด์šฉ์„ ์ฐธ๊ณ ํ•˜์—ฌ ๊ฐ์—ผ๋ณ‘ ํ™•์‚ฐ ๋ฐฉ์ง€๋ฅผ ์œ„ํ•œ ์กฐ์น˜์˜ ํ•„์š”์„ฑ์— ๋Œ€ํ•ด ๋…ผํ•˜์„ธ์š”."
  ]
}
{
  "topic": "๋ฒ•",
  "question": "๊ฐ์—ผ๋ณ‘์˜ ์ „ํŒŒ ๋ฐฉ์ง€ ๋ฐ ์˜ˆ๋ฐฉ์„ ์œ„ํ•˜์—ฌ ์ž๊ฐ€ ๋˜๋Š” ์‹œ์„ค์— ๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ํ•˜๋Š” ๊ฒฝ์šฐ, ์–ด๋–ค ์œ„๋ฐ˜ ํ–‰์œ„๊ฐ€ ์žˆ์„ ์ˆ˜ ์žˆ๋‚˜์š”?",
  "hard_questions": [
    "์ž๊ฐ€๊ฒฉ๋ฆฌ ์กฐ์น˜์˜ ๋Œ€์ƒ์ด ๋˜๊ณ ์ž ํ•˜๋Š” ์ƒํ™ฉ์—์„œ, ๊ฒฉ๋ฆฌ ๊ธฐ๊ฐ„ ๋™์•ˆ์˜ ์ž๊ฐ€๊ฒฉ๋ฆฌ ์‚ฌ์‹ค์„ ๋‹ค๋ฅธ ์‚ฌ๋žŒ์—๊ฒŒ ์•Œ๋ฆฌ์ง€ ์•Š์œผ๋ ค๋Š” ํ–‰์œ„๋Š” ์–ด๋–ค ์œ„๋ฐ˜ ํ–‰์œ„์— ํ•ด๋‹นํ•˜๋‚˜์š”?",
    "์ž๊ฐ€ ๋˜๋Š” ์‹œ์„ค์— ๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ๋ฐ›๋Š” ์ƒํ™ฉ์—์„œ, ํ•ด๋‹น ์กฐ์น˜๋ฅผ ์œ„๋ฐ˜ํ•˜๋Š” ํ–‰์œ„๋Š” ์–ด๋–ค ํ˜•ํƒœ๋กœ ์ด๋ฃจ์–ด์ง€๋‚˜์š”?",
    "์ž๊ฐ€๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ๋ฐ›๋Š” ์‚ฌ๋žŒ ์ค‘, ๊ฒฉ๋ฆฌ ๊ธฐ๊ฐ„ ๋™์•ˆ์˜ ์ž๊ฐ€๊ฒฉ๋ฆฌ ์‚ฌ์‹ค์„ ๋‹ค๋ฅธ ์‚ฌ๋žŒ์—๊ฒŒ ์•Œ๋ฆฌ์ง€ ์•Š์œผ๋ ค๋Š” ์˜๋„๊ฐ€ ์žˆ๋Š” ๊ฒฝ์šฐ, ์–ด๋–ค ๋ฒ•๋ฅ ์— ์œ„๋ฐฐ๋˜๋Š”์ง€ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "๋ฒ•",
  "question": "๊ฐ์—ผ๋ณ‘์˜ ์ „ํŒŒ ๋ฐฉ์ง€๋ฅผ ์œ„ํ•ด ๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ๋ฐ›๋Š” ์‚ฌ๋žŒ์— ๋Œ€ํ•ด ์–ด๋–ค ๊ถŒํ•œ์„ ๊ฐ€์ง€๊ณ  ์žˆ๋‚˜์š”?",
  "hard_questions": [
    "์ž๊ฐ€ ๋˜๋Š” ์‹œ์„ค์— ๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ๋ฐ›๋Š” ์‚ฌ๋žŒ์— ๋Œ€ํ•œ ๊ถŒํ•œ์€ ๋ฌด์—‡์ด๋ฉฐ, ์–ด๋– ํ•œ ์กฐ์น˜๋ฅผ ํ†ตํ•ด ์ด๋ฅผ ํ–‰์‚ฌํ•  ์ˆ˜ ์žˆ๋‚˜์š”?",
    "์ž๊ฐ€ ๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ๋ฐ›์€ ์‚ฌ๋žŒ์œผ๋กœ ํ•˜์—ฌ๊ธˆ ์ž๊ฐ€ ๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ์œ„๋ฐ˜ํ•˜๋Š” ๊ฒฝ์šฐ์— ์–ด๋– ํ•œ ๋ฒ•์  ์กฐ์น˜๋ฅผ ์ทจํ•  ์ˆ˜ ์žˆ๋Š”์ง€ ์˜ˆ์‹œ๋ฅผ ๋“ค์–ด ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์ž๊ฐ€ ๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ์œ„๋ฐ˜ํ•œ ์‚ฌ๋žŒ์— ๋Œ€ํ•ด ์–ด๋–ค ์ฒ˜๋ฒŒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ๋Š”์ง€์— ๋Œ€ํ•ด ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "์˜๋ฃŒ๋ฒ•",
  "question": "ํ”ผ๊ณ ์ธ์ด ๊ฒฉ๋ฆฌ๊ธฐ๊ฐ„ ์ค‘ ์ž๊ฐ€๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ์œ„๋ฐ˜ํ•œ ํ–‰์œ„๊ฐ€ ์˜๋ฃŒ๋ฒ•์˜ ์–ด๋–ค ์กฐํ•ญ์„ ์œ„๋ฐ˜ํ•œ ๊ฒƒ์ธ๊ฐ€์š”?",
  "hard_questions": [
    "์˜๋ฃŒ๋ฒ•์ƒ ์ž๊ฐ€๊ฒฉ๋ฆฌ ์กฐ์น˜์— ๋Œ€ํ•œ ์œ„๋ฐ˜ ํ–‰์œ„์˜ ์ฒ˜๋ฒŒ ๊ธฐ์ค€๊ณผ ๊ตฌ์ฒด์ ์ธ ์กฐํ•ญ์„ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์ž๊ฐ€๊ฒฉ๋ฆฌ ์œ„๋ฐ˜ ํ–‰์œ„์— ๋Œ€ํ•œ ์ฒ˜๋ฒŒ ๊ธฐ์ค€์ด ์˜๋ฃŒ๋ฒ•์ƒ ์–ด๋–ค ์ ˆ์ฐจ๋ฅผ ๋”ฐ๋ฅด๋Š”์ง€ ์ž์„ธํžˆ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์œ„ ์œ„๋ฐ˜ ํ–‰์œ„๊ฐ€ ์˜๋ฃŒ๋ฒ•์— ์˜ํ•œ ์‚ฌํšŒ์งˆ์„œ์˜ ์œ ์ง€์™€ ๊ตญ๋ฏผ์˜ ๊ฑด๊ฐ• ๋ณดํ˜ธ๋ฅผ ์œ„ํ•œ ๊ฒƒ์ธ์ง€ ๋…ผํ•˜์„ธ์š”."
  ]
}
{
  "topic": "๋ฒ•",
  "question": "ํ”ผ๊ณ ์ธ์ด ์ž๊ฐ€๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ์œ„๋ฐ˜ํ•˜์˜€๋‹ค๊ณ  ํ•  ๋•Œ, ์ด๋ฅผ ๋ฐฉ์ง€ํ•˜๊ธฐ ์œ„ํ•œ ๋ฒ•์  ์กฐ์น˜์— ๋Œ€ํ•ด ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "ํ”ผ๊ณ ์ธ์—๊ฒŒ ์–ด๋–ค ์ฒ˜๋ฒŒ์ด ์ ์šฉ๋  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ํ•ด๋‹น ์ฒ˜๋ฒŒ์— ๋Œ€ํ•ด ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์ž๊ฐ€ ๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ์œ„๋ฐ˜ํ•œ ์‚ฌ๋ก€๋ฅผ ๋“ค์–ด, ์ด์— ๋Œ€ํ•œ ๊ณต๊ณต๊ธฐ๊ด€์˜ ์—ญํ• ๊ณผ ์ฑ…์ž„์— ๋Œ€ํ•ด ๋…ผ์˜ํ•ด์ฃผ์„ธ์š”.",
    "๋ฒ•๋ฅ  ์œ„๋ฐ˜์„ ๋ฐฉ์ง€ํ•˜๊ธฐ ์œ„ํ•œ ์‚ฌํšŒ์  ์—ญํ• ๊ณผ ๊ฐœ์ธ์˜ ์ฑ…์ž„์— ๋Œ€ํ•ด ์„œ์ˆ ํ•ด์ฃผ์„ธ์š”."
  ]
}

Writing generation test

{
  "topic": "๊ธฐ์ˆ  ๋ฌธ์„œ ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "์œ„ ์ž๋ฃŒ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ๊ฐ์—ผ๋ณ‘ ์˜ˆ๋ฐฉ ๋ฐ ๊ด€๋ฆฌ์— ๊ด€ํ•œ ๋ฒ•๋ฅ  ์œ„๋ฐ˜ ์‚ฌ๋ก€๋ฅผ ๊ธฐ์ˆ  ๋ฌธ์„œ ํ˜•์‹์œผ๋กœ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "๊ฐ์—ผ๋ณ‘์˜ ์ „ํŒŒ ๋ฐฉ์ง€ ๋ฐ ์˜ˆ๋ฐฉ์„ ์œ„ํ•œ ๋ฒ•์  ๊ถŒํ•œ์— ๋Œ€ํ•ด ์ƒ์„ธํ•˜๊ฒŒ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์ž๊ฐ€๊ฒฉ๋ฆฌ ์กฐ์น˜์˜ ๊ถŒํ•œ๊ณผ ์œ„๋ฐ˜ ์‚ฌ๋ก€์— ๋Œ€ํ•ด ๊ธฐ์ˆ ํ•˜๊ณ , ๊ด€๋ จ ๋ฒ•๋ฅ  ์œ„๋ฐ˜์— ๋”ฐ๋ฅธ ์ œ์žฌ์— ๋Œ€ํ•ด ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์œ„ ์ž๋ฃŒ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ์ž๊ฐ€๊ฒฉ๋ฆฌ ์กฐ์น˜ ์œ„๋ฐ˜ ์‚ฌ๋ก€์— ๋Œ€ํ•œ ์„ค๋ช…๊ณผ ๋ถ„์„ ๊ฒฐ๊ณผ๋ฅผ ์ œ์‹œํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "๊ณ„์•ฝ์„œ ํ˜น์€ ๋ฒ•๋ฅ  ๋ฌธ์„œ ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "์œ„ ์ž๋ฃŒ๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ๊ฐ์—ผ๋ณ‘ ์˜ˆ๋ฐฉ ๋ฐ ๊ด€๋ฆฌ์— ๊ด€ํ•œ ๋ฒ•๋ฅ  ์œ„๋ฐ˜์— ๋Œ€ํ•œ ๊ณ„์•ฝ์„œ๋‚˜ ๋ฒ•๋ฅ  ๋ฌธ์„œ๋ฅผ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "๊ฐ์—ผ๋ณ‘์˜ ์ „ํŒŒ ๋ฐฉ์ง€ ๋ฐ ์˜ˆ๋ฐฉ์„ ์œ„ํ•œ ๋ฒ•๋ฅ  ์œ„๋ฐ˜์— ๋Œ€ํ•œ ์„ค๋ช…๊ณผ ๊ด€๋ จ๋œ ๊ทœ์ •์„ ์ œ์‹œํ•ด์ฃผ์„ธ์š”.",
    "ํ”ผ๊ณ ์ธ์˜ ์ž๊ฐ€๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ์œ„๋ฐ˜ํ•œ ์‚ฌ๊ฑด์— ๋Œ€ํ•ด ๊ตฌ์ฒด์ ์ธ ๊ทผ๊ฑฐ์™€ ๋ฒ•๋ฅ ์ ์ธ ๋Œ€์‘ ๋ฐฉ์•ˆ์„ ๊ธฐ์ˆ ํ•ด์ฃผ์„ธ์š”.",
    "๊ฐ์—ผ๋ณ‘์˜ ์ „ํŒŒ ๋ฐฉ์ง€ ๋ฐ ์˜ˆ๋ฐฉ์„ ์œ„ํ•œ ๊ทœ์ •์— ๋Œ€ํ•œ ๊ด€๋ จ ๋ฒ•๋ฅ ์˜ ๋‚ด์šฉ์„ ์˜ˆ์‹œ์™€ ํ•จ๊ป˜ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "์ผ๊ธฐ ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "์œ„ ์ž๋ฃŒ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ, '์ž๊ฐ€๊ฒฉ๋ฆฌ ์กฐ์น˜์— ๊ด€ํ•œ ์ผ๊ธฐ'๋ฅผ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "์ž๊ฐ€๊ฒฉ๋ฆฌ ์กฐ์น˜๋ฅผ ๋ฐ›๊ณ  ๋‚˜์„œ ๊ฒฉ๋ฆฌํ•œ ๊ฒฝํ—˜์— ๋Œ€ํ•ด ์ž์„ธํžˆ ์„œ์ˆ ํ•ด์ฃผ์„ธ์š”.",
    "์ž๊ฐ€๊ฒฉ๋ฆฌ ์กฐ์น˜ ์ค‘ ๊ฒฉ๋ฆฌ๋Œ€์ƒ์ž๋กœ ์ง€๋ชฉ๋œ ์‚ฌ๋žŒ๊ณผ์˜ ๊ด€๊ณ„๊ฐ€ ์ผ๊ธฐ ์†์— ์–ด๋–ค ์˜ํ–ฅ์„ ๋ฏธ์ณค๋Š”์ง€ ์จ์ฃผ์„ธ์š”.",
    "์ž๊ฐ€๊ฒฉ๋ฆฌ ์กฐ์น˜์— ๋Œ€ํ•œ ์–ด๋ ค์›€๊ณผ ๊ทธ์— ๋Œ€ํ•œ ๋Œ€์ฒ˜ ๋ฐฉ์•ˆ์„ ์ผ๊ธฐ์— ํฌํ•จ์‹œ์ผœ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”."
  ]
}
{
  "topic": "๊ธฐํš์•ˆ ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "์œ„์˜ ๋ฒ•๋ฅ  ์œ„๋ฐ˜ ๋‚ด์šฉ์„ ๋ฐ”ํƒ•์œผ๋กœ, ํ•ด๋‹น ์‚ฌ๊ฑด์„ ๋‹ค๋ฃจ๋Š” ๊ธฐํš์•ˆ์„ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "์–ด๋–ค ๋ถ€๋ถ„์—์„œ ์ค‘์š”ํ•œ ์ ์„ ๊ฐ•์กฐํ•ด์•ผ ํ• ๊นŒ์š”?",
    "์œ„ ์‚ฌ๊ฑด์ด ์‚ฌํšŒ์— ๋ฏธ์น˜๋Š” ์˜ํ–ฅ์— ๋Œ€ํ•ด ๋…ผ์˜ํ•ด๋ณด์„ธ์š”.",
    "์œ„ ์‚ฌ๊ฑด์œผ๋กœ ์ธํ•ด ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ๋Š” ๋ฒ•์  ์ œ์žฌ์— ๋Œ€ํ•ด ์–ธ๊ธ‰ํ•ด๋ณด์„ธ์š”."
  ]
}
{
  "topic": "์—ฐ๊ตฌ ๋…ผ๋ฌธ ๋ฐ ๊ณ„ํš์„œ ๊ด€๋ จ ์ž‘์„ฑ ๋ฌธ์ œ",
  "question": "์œ„ ์ž๋ฃŒ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ์—ฐ๊ตฌ ๋…ผ๋ฌธ ์ œ๋ชฉ์„ ์ œ์•ˆํ•˜๊ณ , ์ฃผ์ œ์— ๋Œ€ํ•ด ๊ฐ„๋žตํ•˜๊ฒŒ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”.",
  "hard_questions": [
    "์ด ๋…ผ๋ฌธ์€ ์–ด๋–ค ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•˜๊ฑฐ๋‚˜ ์–ด๋–ค ๊ณผํ•™์  ๋ฐœ๊ฒฌ์„ ๋ณด๊ณ ํ•  ๊ฒƒ์ด๋ฉฐ, ์—ฐ๊ตฌ์˜ ์ค‘์š”์„ฑ์„ ์„ค๋ช…ํ•ด์ฃผ์„ธ์š”.",
    "์—ฐ๊ตฌ ๋ฐฉ๋ฒ•๊ณผ ๊ณ„ํš์„ ์ƒ์„ธํžˆ ์„ค๋ช…ํ•˜๊ณ , ์—ฐ๊ตฌ์˜ ๊ฒฐ๊ณผ์™€ ๊ฐ€์น˜์— ๋Œ€ํ•ด ๋…ผํ•ด์ฃผ์„ธ์š”.",
    "์ด ์—ฐ๊ตฌ ๋…ผ๋ฌธ์˜ ๊ฒฐ๊ณผ๊ฐ€ ์‚ฌํšŒ์— ๋ฏธ์น  ์˜ํ–ฅ์— ๋Œ€ํ•ด ๋…ผํ•ด๋ณด์„ธ์š”."
  ]
}

์ฃผ์˜์‚ฌํ•ญ

๋‹ค์Œ๊ณผ ๊ฐ™์€ ๋ฌธ์ œ์ ์ด ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ด ๋ฌธ์ œ์ ๋“ค์€ embedding ๋ชจ๋ธ์„ ์ด์šฉํ•˜์—ฌ ํ•„ํ„ฐ๋งํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์˜ˆ์ œ ๋งํฌ

  1. ๊ฐ„ํ˜น ์—ฐ๊ด€์„ฑ์ด ๋‚ฎ์€ ์งˆ๋ฌธ์ด ์ƒ์„ฑ๋œ๋‹ค.
  2. ์œ ์‚ฌํ•œ ์งˆ๋ฌธ์ด ์ƒ์„ฑ๋œ๋‹ค.

์ถ”๊ฐ€๋กœ ์งˆ๋ฌธ์„ ์ด์šฉํ•ด์„œ LLM์œผ๋กœ๋ถ€ํ„ฐ ๋‹ต๋ณ€์„ ์ƒ์„ฑํ•  ๋•Œ ๋‹ค์Œ๊ณผ ๊ฐ™์€ ๋ฌธ์ œ์ ์ด ๋ฐœ์ƒํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

  1. ํ™˜๊ฐ ํ˜„์ƒ (Hallucination)
  2. ์ฃผ์–ด์ง„ text๊ฐ€ ๊ธด ๊ฒฝ์šฐ, ChatGPT๊ฐ€ ๋‹ต๋ณ€์— ์ด์ƒํ•œ ๋ฌธ์ž์—ด (๊ถญ๋ท์•ใ…ใ„ด์•Œ)์ด ๊ฐ„ํ˜น ์ƒ์„ฑ๋˜๋Š” ๋ฌธ์ œ: Perplexity Filter๋กœ ํ•ด๊ฒฐ ๊ฐ€๋Šฅํ•ฉ๋‹ˆ๋‹ค.

Citation

BibTeX:

@misc{bllossom,
  author = {ChangSu Choi, Yongbin Jeong, Seoyoon Park, InHo Won, HyeonSeok Lim, SangMin Kim, Yejee Kang, Chanhyuk Yoon, Jaewan Park, Yiseul Lee, HyeJin Lee, Younggyun Hahm, Hansaem Kim, KyungTae Lim},
  title = {Optimizing Language Augmentation for Multilingual Large Language Models: A Case Study on Korean},
  year = {2024},
  journal = {LREC-COLING 2024},
  paperLink = {\url{https://arxiv.org/pdf/2403.10882}},
 },
}

@misc{cui2023adainstructadaptinginstructiongenerators,
      title={Ada-Instruct: Adapting Instruction Generators for Complex Reasoning}, 
      author={Wanyun Cui and Qianle Wang},
      year={2023},
      eprint={2310.04484},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2310.04484}, 
}

@misc{Genstruct, 
      url={[https://https://huggingface.co/NousResearch/Genstruct-7B](https://huggingface.co/NousResearch/https://huggingface.co/NousResearch/Genstruct-7B)}, 
      title={Genstruct}, 
      author={"euclaise"}
}

Model Card Authors

Framework versions

  • PEFT 0.11.0
Downloads last month
8
Inference API
Unable to determine this modelโ€™s pipeline type. Check the docs .

Model tree for iknow-lab/ko-genstruct-v0.1

Adapter
(55)
this model

Dataset used to train iknow-lab/ko-genstruct-v0.1