download sample datasets fails

[aleksandervines]

TASK [sample_datasets : Download sample datasets] ******************************
failed: [192.168.33.10] (item={u'mapper': u'meris_l1', u'name': u'MER_FRS_1PNPDK20120303_093810_000000333112_00180_52349_3561.N1'}) => {"dest": "/vagrant/shared/test_data/meris_l1/MER_FRS_1PNPDK20120303_093810_000000333112_00180_52349_3561.N1", "failed": true, "item": {"mapper": "meris_l1", "name": "MER_FRS_1PNPDK20120303_093810_000000333112_00180_52349_3561.N1"}, "msg": "Request failed", "response": "OK (113932155 bytes)", "state": "absent", "status_code": null, "url": "ftp://ftp.nersc.no/pub/nansat/test_data/meris_l1/MER_FRS_1PNPDK20120303_093810_000000333112_00180_52349_3561.N1"}
failed: [192.168.33.10] (item={u'mapper': u'asar', u'name': u'ASA_WSM_1PNPDK20081110_205618_000000922073_00401_35024_0844.N1'}) => {"dest": "/vagrant/shared/test_data/asar/ASA_WSM_1PNPDK20081110_205618_000000922073_00401_35024_0844.N1", "failed": true, "item": {"mapper": "asar", "name": "ASA_WSM_1PNPDK20081110_205618_000000922073_00401_35024_0844.N1"}, "msg": "Request failed", "response": "OK (91971150 bytes)", "state": "absent", "status_code": null, "url": "ftp://ftp.nersc.no/pub/nansat/test_data/asar/ASA_WSM_1PNPDK20081110_205618_000000922073_00401_35024_0844.N1"}
failed: [192.168.33.10] (item={u'mapper': u'obpg_l2', u'name': u'A2015121113500.L2_LAC.NorthNorwegianSeas.hdf'}) => {"dest": "/vagrant/shared/test_data/obpg_l2/A2015121113500.L2_LAC.NorthNorwegianSeas.hdf", "failed": true, "item": {"mapper": "obpg_l2", "name": "A2015121113500.L2_LAC.NorthNorwegianSeas.hdf"}, "msg": "Request failed", "response": "OK (104217377 bytes)", "state": "absent", "status_code": null, "url": "ftp://ftp.nersc.no/pub/nansat/test_data/obpg_l2/A2015121113500.L2_LAC.NorthNorwegianSeas.hdf"}
failed: [192.168.33.10] (item={u'mapper': u'obpg_l2', u'name': u'A2015122122000.L2_LAC.NorthNorwegianSeas.hdf'}) => {"dest": "/vagrant/shared/test_data/obpg_l2/A2015122122000.L2_LAC.NorthNorwegianSeas.hdf", "failed": true, "item": {"mapper": "obpg_l2", "name": "A2015122122000.L2_LAC.NorthNorwegianSeas.hdf"}, "msg": "Request failed", "response": "OK (186228481 bytes)", "state": "absent", "status_code": null, "url": "ftp://ftp.nersc.no/pub/nansat/test_data/obpg_l2/A2015122122000.L2_LAC.NorthNorwegianSeas.hdf"}
failed: [192.168.33.10] (item={u'mapper': u'sentinel1a_l1', u'name': u'S1A_EW_GRDM_1SDH_20150702T172954_20150702T173054_006635_008DA5_55D1.zip'}) => {"dest": "/vagrant/shared/test_data/sentinel1a_l1/S1A_EW_GRDM_1SDH_20150702T172954_20150702T173054_006635_008DA5_55D1.zip", "failed": true, "item": {"mapper": "sentinel1a_l1", "name": "S1A_EW_GRDM_1SDH_20150702T172954_20150702T173054_006635_008DA5_55D1.zip"}, "msg": "Request failed", "response": "OK (218558499 bytes)", "state": "absent", "status_code": null, "url": "ftp://ftp.nersc.no/pub/nansat/test_data/sentinel1a_l1/S1A_EW_GRDM_1SDH_20150702T172954_20150702T173054_006635_008DA5_55D1.zip"}

I labeled this as bug since either it should not fail when data is not accessible, or the data should always be accessible.

[mortenwh]

We have a problem with this now, trying to install the develop vm on @evenrev1 - does anyone know the actual problem?

[aleksandervines]

I assume you need these datasets? I should have fixed that it should not fail the provisioning even if the download fails (but I have no idea why they sometimes fail..)

[mortenwh]

They are just downloaded from ftp. The ftp seems to be up, so I don't understand why it doesn't work...

On 19 September 2016 at 11:07, Aleksander Vines notifications@github.com wrote:

I assume you need these datasets? I should have fixed that it should not fail the provisioning even if the download fails (but I have no idea why they sometimes fail..)

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/nansencenter/nersc-vagrant/issues/18#issuecomment-247943560, or mute the thread https://github.com/notifications/unsubscribe-auth/AAGqBZ_2Ld-LNZYzTD3a-CqVL7Jr9gbSks5qrlDKgaJpZM4Iw1H3 .

T.: (+47) 915 47 844

[aleksandervines]

I know.. but somehow they are on occasion failing. I had the problem for a while, Rick had it. And now Even? Previously, the problem magically solved itself in the end, and I still have no idea what the issue was.