Yale-LILY / SummerTime

An open-source text summarization toolkit for non-experts. EMNLP'2021 Demo
https://arxiv.org/abs/2108.12738
Apache License 2.0
268 stars 30 forks source link

ROUGE-WE takes too long to load #21

Closed niansong1996 closed 3 years ago

niansong1996 commented 3 years ago

@zhangir-azerbayev Currently in the demo, when we import the evaluation module, it would prompt "downloading embedding, this could take a while".

This download is repeated everytime we import the evaluation module, which is not really reasonable. I suspect that it is the ROUGE-we score, but needs to be confirmed

Another problem with evaluation is that the package name eval is in conflict with python keywords, so we should move everything to evaluation and update other references accordingly.

niansong1996 commented 3 years ago

@zhangir-azerbayev Is this still a problem or I can close this issue?

zhangir-azerbayev commented 3 years ago

fixed in pr #23