search

fani-lab / OpeNTF

Neural machine learning methods for Team Formation problem.
Other
18 stars 13 forks source link

Benchmark results of uspt #119

Closed hosseinfani closed 2 years ago

hosseinfani commented 2 years ago

We need to include the results of our 16+1 baselines on uspt

karan96 commented 2 years ago

This is to notify you that this issue was acknowledged and we will be performing the benchmark for USPT during the coming week.

karan96 commented 2 years ago

@hosseinfani Benchmarking of the USPT was started. No NS and Uniform was completed and Unigram was in progress.

hosseinfani commented 2 years ago

@karan96 would you please update this page with the running settings of the benchmark? Thank you.

karan96 commented 2 years ago

@hosseinfani Dr. Fani, Kindly let me know if you were able to review the benchmark excel I shared with you, so that I could put it into the format same as other datasets' images on our readme section.

hosseinfani commented 2 years ago

@karan96 I left my comments in your ms-team channel. Also here: Thank you. Here are my comments: 1) there are some absolute 0 in cells. Please investigate why? 2) the AUC tab does not have the results of uspt 3) please create a table for uspt in Paper tab 4) where is the results of random baseline?

hosseinfani commented 2 years ago

An aggregate function has been added to main.py that pulls all the results and put them in an organized csv for each domain. We can safely close this issue.