NTMC-Community / MatchZoo

Facilitating the design, comparison and sharing of deep text matching models.
Apache License 2.0
3.84k stars 897 forks source link

How to get the evaluation index of each query #760

Closed Ivan-Ji closed 4 years ago

Ivan-Ji commented 5 years ago

Describe the Question

In the code, the final evaluation is only the overall evaluation, not the evaluation of each query. So how do I get the evaluations of each query in DSSM?

Ivan-Ji commented 5 years ago

Not the overall index of retrieval

aszhanghuali commented 4 years ago

您好,您说的这个问题您解决了嘛? @Ivan-Ji

Ivan-Ji commented 4 years ago

您好,您说的这个问题您解决了嘛? @Ivan-Ji

No

matthew-z commented 4 years ago

Unfortunately, model.evaluate does not provide such feature at this moment. However, once you get the ranked list for each query, it is quite simple to calculate the scores using other libraries or tools.