nextml / NEXT

NEXT is a machine learning system that runs in the cloud and makes it easy to develop, evaluate, and apply active learning in the real-world. Ask better questions. Get better results. Faster. Automated.
http://nextml.org
Apache License 2.0
160 stars 53 forks source link

ENH: adding targets endpoint #210

Closed stsievert closed 6 years ago

stsievert commented 6 years ago

The target order is unknown when uploading a zip file of images. This PR resolves that problem by adding a /api/experiment/{exp_uid}/targets endpoint.

This PR is a minimal solution to get results (as in #189).

stsievert commented 6 years ago

@sumeetsk and I ran into this today. He wanted this endpoint to verify (target_id, filename) pairs were consistent across experiments after 9e82f9b151818f16cb1597cfbf49be77af6549f4 when using a ZIP file.

stsievert commented 6 years ago

I ran into this again today with a psych person using NEXT. She wanted to verification that NEXT was using the intended targets; there may have been some human error here.

stsievert commented 6 years ago

Looks like https://github.com/nextml/NEXT/pull/210#issuecomment-344013130 caused a practical issue; she didn't upload the correct number of targets. We resolved this with f6cbea9bf44fc567d7f9a443a1dcdecc4514daab