cad0p / maskrcnn-modanet

A Mask R-CNN Keras implementation with Modanet annotations on the Paperdoll dataset
MIT License
72 stars 18 forks source link

Are all the 1 million images annotated ? #15

Open bamal opened 4 years ago

bamal commented 4 years ago

Thanks for facilitating downloading the dataset, did you annotated the 1 million images or only the 50k are annotated ?

cad0p commented 4 years ago

Only 50k are annotated :)

On Fri, Oct 18, 2019, 03:19 Amal notifications@github.com wrote:

Thanks for facilitating downloading the dataset, did you annotated the 1 million images or only the 50k are annotated ?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/cad0p/maskrcnn-modanet/issues/15?email_source=notifications&email_token=ADLUHNRGQJS2OAEVENFLEZTQPEFLVA5CNFSM4JCBLIFKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HSTVW6Q, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADLUHNS65H363LD6WWWBRUDQPEFLVANCNFSM4JCBLIFA .

XGuider commented 4 years ago

Thanks for your best work,but i hava question about modanet dataset. how to only get 50K images,not download all paperdoll dataset?

XGuider commented 4 years ago

@bamal @cad0p

cad0p commented 4 years ago

There is an option on my script, if you run it from your computer

On Wed, Nov 27, 2019, 09:48 XGuider notifications@github.com wrote:

@bamal https://github.com/bamal @cad0p https://github.com/cad0p

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/cad0p/maskrcnn-modanet/issues/15?email_source=notifications&email_token=ADLUHNXK3KCVLGIK63U5NADQVYX7VA5CNFSM4JCBLIFKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEFIYFBI#issuecomment-558989957, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADLUHNUX2EPCZ22JR7LDC4TQVYX7VANCNFSM4JCBLIFA .

XGuider commented 4 years ago

thnx you,which one script?

cad0p commented 4 years ago

It's literally the first script you have to run when you install this package

On Thu, Nov 28, 2019, 03:15 XGuider notifications@github.com wrote:

thnx you,which one script?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/cad0p/maskrcnn-modanet/issues/15?email_source=notifications&email_token=ADLUHNREI7JUMC3TZHJ7SJ3QV4STTA5CNFSM4JCBLIFKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEFLHECA#issuecomment-559313416, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADLUHNXVLUFW2VBD2QB5RD3QV4STTANCNFSM4JCBLIFA .

sampathkumaran90 commented 4 years ago

Hi, I ran the download script it shown me downloading and unzipping but it didn't show anything in the images directory. Could you please help me on that front whether i miss anything?

cad0p commented 4 years ago

Paste output of the program here when you ran the script

sampathkumaran90 commented 4 years ago

Below is the output i get when i ran the download script. NOTE: I am using google colab /content/main/ /usr/local/lib/python3.6/dist-packages/maskrcnn_modanet/ Do you want to download the whole 1 million images (what I had to do) or to just download the 50k annotated with ModaNet? Y for 1 million (40 GB), N for 50k: N downloading paperdoll dataset taken from here: https://github.com/kyamagu/paperdoll/tree/master/data/chictopia

git: 'lfs' is not a git command. See 'git --help'.

The most similar command is log /root/.maskrcnn-modanet saving your path location /content/main/ fast download: True Skipping downloading PaperDoll /content/main/datasets \n now downloading modanet annotations\n \t\t\ttaken from here:\n \t\t\thttps://github.com/eBay/modanet Cloning into 'modanet'... remote: Enumerating objects: 70, done. remote: Total 70 (delta 0), reused 0 (delta 0), pack-reused 70 Unpacking objects: 100% (70/70), done. --2020-04-22 11:51:54-- https://github.com/cad0p/maskrcnn-modanet/releases/download/v1.0.3/modanet2018_instances_train.json Resolving github.com (github.com)... 140.82.118.4 Connecting to github.com (github.com)|140.82.118.4|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/6f984b00-cde4-11e9-872f-ee636321fb6c?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115154Z&X-Amz-Expires=300&X-Amz-Signature=890eac2a6de1eceaaba09db39e00c2557588c51c90896403da5da1f4190c9e7a&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dmodanet2018_instances_train.json&response-content-type=application%2Foctet-stream [following] --2020-04-22 11:51:54-- https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/6f984b00-cde4-11e9-872f-ee636321fb6c?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115154Z&X-Amz-Expires=300&X-Amz-Signature=890eac2a6de1eceaaba09db39e00c2557588c51c90896403da5da1f4190c9e7a&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dmodanet2018_instances_train.json&response-content-type=application%2Foctet-stream Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.8.115 Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.8.115|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 105924292 (101M) [application/octet-stream] Saving to: ‘modanet2018_instances_train.json’

modanet2018_instanc 100%[===================>] 101.02M 29.5MB/s in 3.4s

2020-04-22 11:51:58 (29.5 MB/s) - ‘modanet2018_instances_train.json’ saved [105924292/105924292]

--2020-04-22 11:51:58-- https://github.com/cad0p/maskrcnn-modanet/releases/download/v1.0.3/modanet2018_instances_val.json Resolving github.com (github.com)... 140.82.118.4 Connecting to github.com (github.com)|140.82.118.4|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/6f984b00-cde4-11e9-97db-80e1d6bc038f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115158Z&X-Amz-Expires=300&X-Amz-Signature=1d2f7f1a9f44250415f2844c9d8c829934b8cb5307ce3af00a07a02009bde347&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dmodanet2018_instances_val.json&response-content-type=application%2Foctet-stream [following] --2020-04-22 11:51:59-- https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/6f984b00-cde4-11e9-97db-80e1d6bc038f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115158Z&X-Amz-Expires=300&X-Amz-Signature=1d2f7f1a9f44250415f2844c9d8c829934b8cb5307ce3af00a07a02009bde347&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dmodanet2018_instances_val.json&response-content-type=application%2Foctet-stream Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.145.19 Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.145.19|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 215183 (210K) [application/octet-stream] Saving to: ‘modanet2018_instances_val.json’

modanet2018_instanc 100%[===================>] 210.14K 820KB/s in 0.3s

2020-04-22 11:51:59 (820 KB/s) - ‘modanet2018_instances_val.json’ saved [215183/215183]

/content/main/datasets/coco downloading the images folder.. (2 GB) --2020-04-22 11:51:59-- https://github.com/cad0p/maskrcnn-modanet/releases/download/v0.9/images.zip Resolving github.com (github.com)... 140.82.118.3 Connecting to github.com (github.com)|140.82.118.3|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/b6d3ac80-9fea-11e9-960d-30e52ebc3bcc?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115159Z&X-Amz-Expires=300&X-Amz-Signature=0e5ebcdad216f878a3bc68d29f4abcd2d45d6a40cadc98dc3af66cfdb8613012&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dimages.zip&response-content-type=application%2Foctet-stream [following] --2020-04-22 11:51:59-- https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/b6d3ac80-9fea-11e9-960d-30e52ebc3bcc?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115159Z&X-Amz-Expires=300&X-Amz-Signature=0e5ebcdad216f878a3bc68d29f4abcd2d45d6a40cadc98dc3af66cfdb8613012&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dimages.zip&response-content-type=application%2Foctet-stream Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.145.19 Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.145.19|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 2115906618 (2.0G) [application/octet-stream] Saving to: ‘images.zip’

images.zip 100%[===================>] 1.97G 34.7MB/s in 59s

2020-04-22 11:52:59 (34.1 MB/s) - ‘images.zip’ saved [2115906618/2115906618]

unzipping.. /content/main/datasets/coco/annotations now downloading fixed ModaNet annotations (this can also be done with datasets fix command) --2020-04-22 11:53:25-- https://github.com/cad0p/maskrcnn-modanet/releases/download/v0.9/instances_all.json Resolving github.com (github.com)... 140.82.118.3 Connecting to github.com (github.com)|140.82.118.3|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/87c43780-9ff8-11e9-8d0d-60e271df9011?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115325Z&X-Amz-Expires=300&X-Amz-Signature=ba5a9619e18ea3496d2a3bdfa12f3cce74acb9f2b490231f500a4c597acb2f66&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dinstances_all.json&response-content-type=application%2Foctet-stream [following] --2020-04-22 11:53:25-- https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/87c43780-9ff8-11e9-8d0d-60e271df9011?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115325Z&X-Amz-Expires=300&X-Amz-Signature=ba5a9619e18ea3496d2a3bdfa12f3cce74acb9f2b490231f500a4c597acb2f66&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dinstances_all.json&response-content-type=application%2Foctet-stream Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.186.59 Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.186.59|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 124180077 (118M) [application/octet-stream] Saving to: ‘instances_all.json’

instances_all.json 100%[===================>] 118.43M 33.7MB/s in 4.0s

2020-04-22 11:53:30 (29.6 MB/s) - ‘instances_all.json’ saved [124180077/124180077]

/content/main/results downloading the default coco snapshot --2020-04-22 11:53:34-- https://github.com/fizyr/keras-maskrcnn/releases/download/0.2.2/resnet50_coco_v0.2.0.h5 Resolving github.com (github.com)... 140.82.118.3 Connecting to github.com (github.com)|140.82.118.3|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/124870610/d5ca1180-934f-11e9-8447-d8787953f5d8?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115334Z&X-Amz-Expires=300&X-Amz-Signature=3008beb21791b53941011d0f2ad34fcb12c8da4bc4c058bb123bef39d910b84d&X-Amz-SignedHeaders=host&actor_id=0&repo_id=124870610&response-content-disposition=attachment%3B%20filename%3Dresnet50_coco_v0.2.0.h5&response-content-type=application%2Foctet-stream [following] --2020-04-22 11:53:34-- https://github-production-release-asset-2e65be.s3.amazonaws.com/124870610/d5ca1180-934f-11e9-8447-d8787953f5d8?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115334Z&X-Amz-Expires=300&X-Amz-Signature=3008beb21791b53941011d0f2ad34fcb12c8da4bc4c058bb123bef39d910b84d&X-Amz-SignedHeaders=host&actor_id=0&repo_id=124870610&response-content-disposition=attachment%3B%20filename%3Dresnet50_coco_v0.2.0.h5&response-content-type=application%2Foctet-stream Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.204.139 Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.204.139|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 164564448 (157M) [application/octet-stream] Saving to: ‘resnet50_coco_v0.2.0.h5’

resnet50_coco_v0.2. 100%[===================>] 156.94M 35.2MB/s in 5.1s

2020-04-22 11:53:40 (31.1 MB/s) - ‘resnet50_coco_v0.2.0.h5’ saved [164564448/164564448]

downloading the last available trained modanet snapshot --2020-04-22 11:53:40-- https://github.com/cad0p/maskrcnn-modanet/releases/download/v1.0/resnet50_modanet.h5 Resolving github.com (github.com)... 140.82.118.4 Connecting to github.com (github.com)|140.82.118.4|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/e0163a80-a0c7-11e9-98e8-0f0376825af5?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115340Z&X-Amz-Expires=300&X-Amz-Signature=4f32b01d451729d5e9a96cbdbe3fd631f34ee4ef6cb84059599a9432032cc2e0&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dresnet50_modanet.h5&response-content-type=application%2Foctet-stream [following] --2020-04-22 11:53:40-- https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/e0163a80-a0c7-11e9-98e8-0f0376825af5?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115340Z&X-Amz-Expires=300&X-Amz-Signature=4f32b01d451729d5e9a96cbdbe3fd631f34ee4ef6cb84059599a9432032cc2e0&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dresnet50_modanet.h5&response-content-type=application%2Foctet-stream Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.217.44.236 Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.217.44.236|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 474901896 (453M) [application/octet-stream] Saving to: ‘resnet50_modanet.h5’

resnet50_modanet.h5 100%[===================>] 452.90M 34.6MB/s in 14s

2020-04-22 11:53:54 (33.3 MB/s) - ‘resnet50_modanet.h5’ saved [474901896/474901896]

/content/main/results/processedimages /content/main/ ├── datasets │ ├── coco │ │ ├── annotations │ │ └── images │ └── modanet │ ├── annotations │ └── logo └── results ├── logs ├── processedimages │ ├── annotations │ ├── images │ └── imagesegments └── snapshots

14 directories If you don't have tree installed, just install it for bash terminal and run this command again: maskrcnn-modanet datasets download

This command also stores your saved variables with the default values. run 'maskrcnn-modanet savedvars show' to see them

Now run 'maskrcnn-modanet datasets arrange'

cad0p commented 4 years ago

have you checked the images directory under here? /content/main/datasets/coco

sampathkumaran90 commented 4 years ago

yeah thank you... But the code to show the process image has errors... NameError: name 'Image' is not defined

sampathkumaran90 commented 4 years ago

These are the commands i gave from PIL import Image !maskrcnn-modanet processimage save image -p "1115865.jpg"

kindly do the needful

cad0p commented 4 years ago

Yeah I fixed that a month ago but haven't updated the package :D

If you clone it from GitHub instead of installing with pip it should work even right now

I'll update the package ASAP!

sampathkumaran90 commented 4 years ago

Thanks, it is working fine