The results of matchzoo

NTMC-Community / MatchZoo

Facilitating the design, comparison and sharing of deep text matching models.

Apache License 2.0

3.82k stars 898 forks source link

The results of matchzoo #813

Closed xuezzz closed 4 years ago

xuezzz commented 4 years ago

Hi, I wonder the results of the tutorials/wikiqa/esim is the dev datas or the test datas, if it's dev data's result, how can I see the test data's result, and if test data's result , so on!
Thanks!

xuezzz commented 4 years ago

oh! all the files of the wikiqa/ And why the result of esim.ipynb only have MAP but don't have NDCG

bwanglzu commented 4 years ago

checkout readme or tutorials.

You can add NDCG to your metrics:

ranking_task.metrics = [
    mz.metrics.NormalizedDiscountedCumulativeGain(k=3), # NDCG
    mz.metrics.MeanAveragePrecision() # MAP
]