Spaces:
Running
Running
seonil
commited on
Commit
•
b5bad93
1
Parent(s):
f469daa
unbold for visibility
Browse files- README.md +1 -1
- harim_plus.py +1 -1
README.md
CHANGED
@@ -17,7 +17,7 @@ description: >-
|
|
17 |
|
18 |
|
19 |
# HaRiM+
|
20 |
-
|
21 |
<br />
|
22 |
HaRiM+ is reference-less metric for summarization task which hurls the power of summarization model to estimate the quality of the summary-article pair. <br />
|
23 |
Note that this metric is reference-free and do not require training. It is ready to go without reference text to compare with the generation nor any model training for scoring.
|
|
|
17 |
|
18 |
|
19 |
# HaRiM+
|
20 |
+
HaRiM+: Evaluating Summary Quality with Hallucination Risk, accepted at AACL-22 [paper](https://arxiv.org/abs/2211.12118). <br />
|
21 |
<br />
|
22 |
HaRiM+ is reference-less metric for summarization task which hurls the power of summarization model to estimate the quality of the summary-article pair. <br />
|
23 |
Note that this metric is reference-free and do not require training. It is ready to go without reference text to compare with the generation nor any model training for scoring.
|
harim_plus.py
CHANGED
@@ -30,7 +30,7 @@ _CITATION = """\
|
|
30 |
}
|
31 |
"""
|
32 |
|
33 |
-
_DESCRIPTION = f"""
|
34 |
Summarization model inside the HaRiM+ will read and evaluate how good the quality of a summary given the paired article.
|
35 |
It will work great for ranking the summary-article pairs according to its quality.
|
36 |
|
|
|
30 |
}
|
31 |
"""
|
32 |
|
33 |
+
_DESCRIPTION = f"""HaRiM+ is a reference-less evaluation metric (i.e. requires only article-summary pair, no reference summary) for summarization which hurls the power of summarization model.
|
34 |
Summarization model inside the HaRiM+ will read and evaluate how good the quality of a summary given the paired article.
|
35 |
It will work great for ranking the summary-article pairs according to its quality.
|
36 |
|