search

vecto-ai / vecto

Doing things with embeddings
http://vecto.space/
Mozilla Public License 2.0
64 stars 11 forks source link

How can we interpret the results? #74

Closed flyaway1217 closed 4 years ago

flyaway1217 commented 5 years ago

Hi, there, I have finished the first evaluation on BATS dataset. The result file is a json file which contains 5840964 lines. How can we interpret it? What I am looking for is one single number that can indicate the performance of my word embeddings.

libofang commented 5 years ago

Hi, flyaway1217

Please check the entry

experiment_setup.default_measurement

In the case of word analogy, this should be

accuracy

You can find the performance score in this entry.

flyaway1217 commented 5 years ago

I find there are many accuracy entries. I assume each dataset in BATS has an accuracy? I want to know the overall performance on the whole BATS. Is these any number that can indicate this?

libofang commented 5 years ago

Oh, sorry that we don't have an overall performance score. However, you can just average them to get one socre. : )