ROUGE Metric
The Recall-Oriented Understudy for Gisting Evaluation (ROUGE)(Lin et al., 2004) is a metric, commonly used to measure the accuracy of text summarization models. Summarization is one of the most difficult tasks to measure because there is no straightforward way to do it. The ROUGE score is one of the most used metrics for summarization. This metric compares a generated summary to a set of human-created reference summaries. Using ROUGE, recall is calculated based on how much of the reference summary is represented by the generated summary. ROUGE refers to a set of metrics. Those most likely to be used are ROUGE-N, ROUGE-L, and ROUGE-LSUM. The ROUGE-N metric measures how many ‘n-grams’ match between our model-generated text and the reference text. In simple terms, n-grams are groups of words or tokens. There is only one word in a unigram (1-gram) and two consecutive words in a bigram(2-gram). ROUGE-N uses n-grams to represent the gram. In ROUGE-1, we are measuring the match-rate of unigra...