search

innosoft-pro / label-them

MIT License
6 stars 3 forks source link

Offline approvement is not working #21

Closed nmingazov closed 7 years ago

nmingazov commented 7 years ago

Basically, I can't see contours when I'm trying to understand should I approve or rejected the image.

screen shot 2017-06-27 at 18 55 50

Nevertheless, when I'm downloading results rejected by me they actually have something inside. In the archive below you can find example .tsv results - all and rejected only.

ExampleTSV.zip

AlNedorezov commented 7 years ago

@nmingazov, delayed acceptance feature was implemented in version 1.4, and is now available in develop-toloka branch. See this video for usage reference.

NOTE: You can also download the source files that are needed to run the system on Yandex Toloka crowdsourcing platform (main.html, app.js, and concat.min.css) from the "Releases - Version 1.4." repository page. Screenshot from 2017-07-09 23-54-27.png

mihbort commented 7 years ago

I tried your new release and find out the following bugs in delayed acceptance mode:

AlNedorezov commented 7 years ago

@mihbort, thank you for your feedback.

Navigation using hand instrument isn't working at all

Please, elaborate more on this. What exactly is not working? If possible, record a screencast showing inappropriate system behavior, provided with your comments.

It would be great if near marked blobs will be shown their's classes.

We'll take your feedback into account.

As for other points, we are considering whether delayed acceptance users will need to perform minor fixes of (possibly extremely complex) markup submitted by Mechanical Turks, and, consequently, will need to use the full spectrum of markup functionality.

For the release 1.4 we concentrated on the straightforward delayed acceptance functionality, meaning checking out objects marked up by Mechanical Turks, their classes and parameters (which can be viewed in the "Label Parameters" block, after the marked up object was selected with the "Hand" tool).

nmingazov commented 7 years ago

@AlNedorezov @mihbort we could close this issue and split the improvements into different tasks, I believe this is a better way to track it. Is it ok for everyone?

mihbort commented 7 years ago

@nmingazov It's Ok. In each task I can explain better what is wrong.

AlNedorezov commented 7 years ago

@nmingazov, it's ok. I agree that it will be a better way to track issues and improvements.

mihbort commented 7 years ago
  • If I click in empty space, always creates new point. I think it is not needed for acceptance mod.
  • During the zoom, points are not moving with the picture and stand still.

I wasn't able to repeat these bug again, so decided not to open such issues. What about this issue, I think it can be closed.