Open bamal opened 4 years ago
Only 50k are annotated :)
On Fri, Oct 18, 2019, 03:19 Amal notifications@github.com wrote:
Thanks for facilitating downloading the dataset, did you annotated the 1 million images or only the 50k are annotated ?
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/cad0p/maskrcnn-modanet/issues/15?email_source=notifications&email_token=ADLUHNRGQJS2OAEVENFLEZTQPEFLVA5CNFSM4JCBLIFKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HSTVW6Q, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADLUHNS65H363LD6WWWBRUDQPEFLVANCNFSM4JCBLIFA .
Thanks for your best work,but i hava question about modanet dataset. how to only get 50K images,not download all paperdoll dataset?
@bamal @cad0p
There is an option on my script, if you run it from your computer
On Wed, Nov 27, 2019, 09:48 XGuider notifications@github.com wrote:
@bamal https://github.com/bamal @cad0p https://github.com/cad0p
— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/cad0p/maskrcnn-modanet/issues/15?email_source=notifications&email_token=ADLUHNXK3KCVLGIK63U5NADQVYX7VA5CNFSM4JCBLIFKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEFIYFBI#issuecomment-558989957, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADLUHNUX2EPCZ22JR7LDC4TQVYX7VANCNFSM4JCBLIFA .
thnx you,which one script?
It's literally the first script you have to run when you install this package
On Thu, Nov 28, 2019, 03:15 XGuider notifications@github.com wrote:
thnx you,which one script?
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/cad0p/maskrcnn-modanet/issues/15?email_source=notifications&email_token=ADLUHNREI7JUMC3TZHJ7SJ3QV4STTA5CNFSM4JCBLIFKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEFLHECA#issuecomment-559313416, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADLUHNXVLUFW2VBD2QB5RD3QV4STTANCNFSM4JCBLIFA .
Hi, I ran the download script it shown me downloading and unzipping but it didn't show anything in the images directory. Could you please help me on that front whether i miss anything?
Paste output of the program here when you ran the script
Below is the output i get when i ran the download script. NOTE: I am using google colab /content/main/ /usr/local/lib/python3.6/dist-packages/maskrcnn_modanet/ Do you want to download the whole 1 million images (what I had to do) or to just download the 50k annotated with ModaNet? Y for 1 million (40 GB), N for 50k: N downloading paperdoll dataset taken from here: https://github.com/kyamagu/paperdoll/tree/master/data/chictopia
git: 'lfs' is not a git command. See 'git --help'.
The most similar command is log /root/.maskrcnn-modanet saving your path location /content/main/ fast download: True Skipping downloading PaperDoll /content/main/datasets \n now downloading modanet annotations\n \t\t\ttaken from here:\n \t\t\thttps://github.com/eBay/modanet Cloning into 'modanet'... remote: Enumerating objects: 70, done. remote: Total 70 (delta 0), reused 0 (delta 0), pack-reused 70 Unpacking objects: 100% (70/70), done. --2020-04-22 11:51:54-- https://github.com/cad0p/maskrcnn-modanet/releases/download/v1.0.3/modanet2018_instances_train.json Resolving github.com (github.com)... 140.82.118.4 Connecting to github.com (github.com)|140.82.118.4|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/6f984b00-cde4-11e9-872f-ee636321fb6c?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115154Z&X-Amz-Expires=300&X-Amz-Signature=890eac2a6de1eceaaba09db39e00c2557588c51c90896403da5da1f4190c9e7a&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dmodanet2018_instances_train.json&response-content-type=application%2Foctet-stream [following] --2020-04-22 11:51:54-- https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/6f984b00-cde4-11e9-872f-ee636321fb6c?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115154Z&X-Amz-Expires=300&X-Amz-Signature=890eac2a6de1eceaaba09db39e00c2557588c51c90896403da5da1f4190c9e7a&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dmodanet2018_instances_train.json&response-content-type=application%2Foctet-stream Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.8.115 Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.8.115|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 105924292 (101M) [application/octet-stream] Saving to: ‘modanet2018_instances_train.json’
modanet2018_instanc 100%[===================>] 101.02M 29.5MB/s in 3.4s
2020-04-22 11:51:58 (29.5 MB/s) - ‘modanet2018_instances_train.json’ saved [105924292/105924292]
--2020-04-22 11:51:58-- https://github.com/cad0p/maskrcnn-modanet/releases/download/v1.0.3/modanet2018_instances_val.json Resolving github.com (github.com)... 140.82.118.4 Connecting to github.com (github.com)|140.82.118.4|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/6f984b00-cde4-11e9-97db-80e1d6bc038f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115158Z&X-Amz-Expires=300&X-Amz-Signature=1d2f7f1a9f44250415f2844c9d8c829934b8cb5307ce3af00a07a02009bde347&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dmodanet2018_instances_val.json&response-content-type=application%2Foctet-stream [following] --2020-04-22 11:51:59-- https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/6f984b00-cde4-11e9-97db-80e1d6bc038f?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115158Z&X-Amz-Expires=300&X-Amz-Signature=1d2f7f1a9f44250415f2844c9d8c829934b8cb5307ce3af00a07a02009bde347&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dmodanet2018_instances_val.json&response-content-type=application%2Foctet-stream Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.145.19 Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.145.19|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 215183 (210K) [application/octet-stream] Saving to: ‘modanet2018_instances_val.json’
modanet2018_instanc 100%[===================>] 210.14K 820KB/s in 0.3s
2020-04-22 11:51:59 (820 KB/s) - ‘modanet2018_instances_val.json’ saved [215183/215183]
/content/main/datasets/coco downloading the images folder.. (2 GB) --2020-04-22 11:51:59-- https://github.com/cad0p/maskrcnn-modanet/releases/download/v0.9/images.zip Resolving github.com (github.com)... 140.82.118.3 Connecting to github.com (github.com)|140.82.118.3|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/b6d3ac80-9fea-11e9-960d-30e52ebc3bcc?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115159Z&X-Amz-Expires=300&X-Amz-Signature=0e5ebcdad216f878a3bc68d29f4abcd2d45d6a40cadc98dc3af66cfdb8613012&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dimages.zip&response-content-type=application%2Foctet-stream [following] --2020-04-22 11:51:59-- https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/b6d3ac80-9fea-11e9-960d-30e52ebc3bcc?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115159Z&X-Amz-Expires=300&X-Amz-Signature=0e5ebcdad216f878a3bc68d29f4abcd2d45d6a40cadc98dc3af66cfdb8613012&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dimages.zip&response-content-type=application%2Foctet-stream Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.145.19 Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.145.19|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 2115906618 (2.0G) [application/octet-stream] Saving to: ‘images.zip’
images.zip 100%[===================>] 1.97G 34.7MB/s in 59s
2020-04-22 11:52:59 (34.1 MB/s) - ‘images.zip’ saved [2115906618/2115906618]
unzipping.. /content/main/datasets/coco/annotations now downloading fixed ModaNet annotations (this can also be done with datasets fix command) --2020-04-22 11:53:25-- https://github.com/cad0p/maskrcnn-modanet/releases/download/v0.9/instances_all.json Resolving github.com (github.com)... 140.82.118.3 Connecting to github.com (github.com)|140.82.118.3|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/87c43780-9ff8-11e9-8d0d-60e271df9011?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115325Z&X-Amz-Expires=300&X-Amz-Signature=ba5a9619e18ea3496d2a3bdfa12f3cce74acb9f2b490231f500a4c597acb2f66&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dinstances_all.json&response-content-type=application%2Foctet-stream [following] --2020-04-22 11:53:25-- https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/87c43780-9ff8-11e9-8d0d-60e271df9011?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115325Z&X-Amz-Expires=300&X-Amz-Signature=ba5a9619e18ea3496d2a3bdfa12f3cce74acb9f2b490231f500a4c597acb2f66&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dinstances_all.json&response-content-type=application%2Foctet-stream Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.186.59 Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.186.59|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 124180077 (118M) [application/octet-stream] Saving to: ‘instances_all.json’
instances_all.json 100%[===================>] 118.43M 33.7MB/s in 4.0s
2020-04-22 11:53:30 (29.6 MB/s) - ‘instances_all.json’ saved [124180077/124180077]
/content/main/results downloading the default coco snapshot --2020-04-22 11:53:34-- https://github.com/fizyr/keras-maskrcnn/releases/download/0.2.2/resnet50_coco_v0.2.0.h5 Resolving github.com (github.com)... 140.82.118.3 Connecting to github.com (github.com)|140.82.118.3|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/124870610/d5ca1180-934f-11e9-8447-d8787953f5d8?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115334Z&X-Amz-Expires=300&X-Amz-Signature=3008beb21791b53941011d0f2ad34fcb12c8da4bc4c058bb123bef39d910b84d&X-Amz-SignedHeaders=host&actor_id=0&repo_id=124870610&response-content-disposition=attachment%3B%20filename%3Dresnet50_coco_v0.2.0.h5&response-content-type=application%2Foctet-stream [following] --2020-04-22 11:53:34-- https://github-production-release-asset-2e65be.s3.amazonaws.com/124870610/d5ca1180-934f-11e9-8447-d8787953f5d8?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115334Z&X-Amz-Expires=300&X-Amz-Signature=3008beb21791b53941011d0f2ad34fcb12c8da4bc4c058bb123bef39d910b84d&X-Amz-SignedHeaders=host&actor_id=0&repo_id=124870610&response-content-disposition=attachment%3B%20filename%3Dresnet50_coco_v0.2.0.h5&response-content-type=application%2Foctet-stream Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.216.204.139 Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.216.204.139|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 164564448 (157M) [application/octet-stream] Saving to: ‘resnet50_coco_v0.2.0.h5’
resnet50_coco_v0.2. 100%[===================>] 156.94M 35.2MB/s in 5.1s
2020-04-22 11:53:40 (31.1 MB/s) - ‘resnet50_coco_v0.2.0.h5’ saved [164564448/164564448]
downloading the last available trained modanet snapshot --2020-04-22 11:53:40-- https://github.com/cad0p/maskrcnn-modanet/releases/download/v1.0/resnet50_modanet.h5 Resolving github.com (github.com)... 140.82.118.4 Connecting to github.com (github.com)|140.82.118.4|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/e0163a80-a0c7-11e9-98e8-0f0376825af5?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115340Z&X-Amz-Expires=300&X-Amz-Signature=4f32b01d451729d5e9a96cbdbe3fd631f34ee4ef6cb84059599a9432032cc2e0&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dresnet50_modanet.h5&response-content-type=application%2Foctet-stream [following] --2020-04-22 11:53:40-- https://github-production-release-asset-2e65be.s3.amazonaws.com/184780048/e0163a80-a0c7-11e9-98e8-0f0376825af5?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200422%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200422T115340Z&X-Amz-Expires=300&X-Amz-Signature=4f32b01d451729d5e9a96cbdbe3fd631f34ee4ef6cb84059599a9432032cc2e0&X-Amz-SignedHeaders=host&actor_id=0&repo_id=184780048&response-content-disposition=attachment%3B%20filename%3Dresnet50_modanet.h5&response-content-type=application%2Foctet-stream Resolving github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)... 52.217.44.236 Connecting to github-production-release-asset-2e65be.s3.amazonaws.com (github-production-release-asset-2e65be.s3.amazonaws.com)|52.217.44.236|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 474901896 (453M) [application/octet-stream] Saving to: ‘resnet50_modanet.h5’
resnet50_modanet.h5 100%[===================>] 452.90M 34.6MB/s in 14s
2020-04-22 11:53:54 (33.3 MB/s) - ‘resnet50_modanet.h5’ saved [474901896/474901896]
/content/main/results/processedimages /content/main/ ├── datasets │ ├── coco │ │ ├── annotations │ │ └── images │ └── modanet │ ├── annotations │ └── logo └── results ├── logs ├── processedimages │ ├── annotations │ ├── images │ └── imagesegments └── snapshots
14 directories If you don't have tree installed, just install it for bash terminal and run this command again: maskrcnn-modanet datasets download
This command also stores your saved variables with the default values. run 'maskrcnn-modanet savedvars show' to see them
Now run 'maskrcnn-modanet datasets arrange'
have you checked the images directory under here? /content/main/datasets/coco
yeah thank you... But the code to show the process image has errors... NameError: name 'Image' is not defined
These are the commands i gave from PIL import Image !maskrcnn-modanet processimage save image -p "1115865.jpg"
kindly do the needful
Yeah I fixed that a month ago but haven't updated the package :D
If you clone it from GitHub instead of installing with pip it should work even right now
I'll update the package ASAP!
Thanks, it is working fine
Thanks for facilitating downloading the dataset, did you annotated the 1 million images or only the 50k are annotated ?