Just learn two facts about ROUGE (1) rouge_score is a convenient package, and I personally checkedit gives the same output as the traditional (but painful!!) perl version. (2) Typically f-measure is reported in papers nowadays, although ROUGE stands for “Recall-Oriented bla....”