|
--- |
|
license: apache-2.0 |
|
datasets: |
|
- yuyijiong/Long-Instruction-with-Paraphrasing |
|
language: |
|
- zh |
|
- en |
|
--- |
|
[Qwen1.5-4B-Chat](https://huggingface.co/Qwen/Qwen1.5-4B-Chat)模型在 |
|
[Long-Instruction-with-Paraphrasing](yuyijiong/Long-Instruction-with-Paraphrasing)数据集上微调，提升了 long-context 能力 |
|
|
|
## Eval on LongBench |
|
long-context 能力得到提升 |
|
|
|
|model| score| average score| |
|
|--|--|--| |
|
|Qwen1.5-4B-Chat|'dureader': 33.61<br>'hotpotqa': 96.5,'lsht': 41.0<br>'multifieldqa_en': 100.0<br>'multifieldqa_zh': 55.4<br>'passage_retrieval_en': 13.0<br>'passage_retrieval_zh': 16.5<br>'qmsum': 22.69<br>'trec': 73.0<br>'vcsum': 15.65|46.73| |
|
|Qwen1.5-4b-chat-paraph|{'dureader': 31.54<br>'hotpotqa': 99.0<br>'lsht': 39.5<br>'multifieldqa_en': 100.0<br>'multifieldqa_zh': 48.41<br>'passage_retrieval_en': 74.5<br>'passage_retrieval_zh': 62.5<br>'qmsum': 23.9<br>'trec': 74.5<br>'vcsum': 15.79}| **56.96**| |
