search

olivierhagolle / LANDSAT-Download

Automated download of LANDSAT data from USGS website
http://olivierhagolle.github.io/LANDSAT-Download
GNU General Public License v3.0
204 stars 97 forks source link

Collection Products #39

Open Opadera opened 7 years ago

Opadera commented 7 years ago

The tool doesn't seem to pick up the new l8 collection format. The old format is discontinued.

olivierhagolle commented 7 years ago

True, I need to find time to work n it. Olivier

olivierhagolle commented 7 years ago

Looks like we have to replace: https://earthexplorer.usgs.gov/download/4923/LC81990302017115LGN00/STANDARD/EE by https://earthexplorer.usgs.gov/download/12864/LC81990302017115LGN00/STANDARD/EE

I am surprised it is so simple... Olivier

olivierhagolle commented 7 years ago

I have corrected it, but earthexplorer is down for maintenance, I cannot test. I will try later. Olivier

olivierhagolle commented 7 years ago

Well, still Error 503, service unavailable Strange.

bmurch commented 7 years ago

Their response is this but as you said, its been ongoing:

Brock,

We have been down for maintenance. On our sites, we have this message posted:

Required Infrastructure Maintenance to Interrupt Data Downloads, Data Processing, and Website Access.

Due to required infrastructure maintenance, this site will be unavailable beginning at 6:00 am CDT, Wednesday, May 17, 2017. Users can expect data distribution and processing interruptions to last until 12:00 pm CDT, Thursday, May 18, 2017.

We apologize for any inconvenience this interruption may cause, and appreciate your patience.

Renee

USGS EROS User Services 47914 252nd Street Sioux Falls, SD 57198-0001 Phone: (605) 594-6151 FAX: (605) 594-6589

On 05/11/2017 04:11 PM, Olivier Hagolle wrote:

I have corrected it, but eartheplorer is down for maintenance, I cannot test. I will try later. Olivier

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/olivierhagolle/LANDSAT-Download/issues/39#issuecomment-300903603, or mute the thread https://github.com/notifications/unsubscribe-auth/AGQL96AgXR0VrpszlytBFAmxXsw4Am9xks5r42uMgaJpZM4NWryr.

-- Brock Murch Senior Systems Administrator College of Marine Science University of South Florida

olivierhagolle commented 7 years ago

Thanks, I'll' try tomorrow then. Olivier

bmurch commented 7 years ago

Oliver,

I just tired this:

./download_landsat_scene.py -o scene -b LC8 --start_date=20170516 --end_date=20170517 -s 001049 -u usgs.txt --output ./

But it didn't return anything.

None None Searching for images on (julian date): 2017136... https://earthexplorer.usgs.gov/download/4923/LC80010492017136LGN00/STANDARD/EE https://earthexplorer.usgs.gov/download/4923/LC80010492017136LGN01/STANDARD/EE https://earthexplorer.usgs.gov/download/4923/LC80010492017136LGN02/STANDARD/EE

But It should have.

Brock

On 05/18/2017 10:07 AM, Olivier Hagolle wrote:

Thanks, I'll' try tomorrow then. Olivier

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/olivierhagolle/LANDSAT-Download/issues/39#issuecomment-302414409, or mute the thread https://github.com/notifications/unsubscribe-auth/AGQL94Tqi8DafuGiGsJ_T_IDCcaOriARks5r7FCqgaJpZM4NWryr.

-- Brock Murch Senior Systems Administrator College of Marine Science University of South Florida

bmurch commented 7 years ago

Note that the test I ran was with my Dec 24th version of the script. It produced:

LANDSAT-Download-master> ./download_landsat_scene.py -o scene -b LC8 --start_date=20170516 --end_date=20170517 -s 001049 -u usgs.txt --output ./ None None Searching for images on (julian date): 2017136... https://earthexplorer.usgs.gov/download/4923/LC80010492017136LGN00/STANDARD/EE https://earthexplorer.usgs.gov/download/4923/LC80010492017136LGN01/STANDARD/EE https://earthexplorer.usgs.gov/download/4923/LC80010492017136LGN02/STANDARD/EE

However, the currently posted version produced:

LANDSAT-Download-master> ./download_landsat_scene.py.051217 -o scene -b LC8 --start_date=20170516 --end_date=20170517 -s 001049 -u usgs.txt --output ./ None None elw/FA== Traceback (most recent call last): File "./download_landsat_scene.py.051217", line 605, in main() File "./download_landsat_scene.py.051217", line 420, in main connect_earthexplorer_no_proxy(usgs) File "./download_landsat_scene.py.051217", line 85, in connect_earthexplorer_no_proxy f = urllib2.urlopen(request) File "/usr/lib64/python2.7/urllib2.py", line 154, in urlopen return opener.open(url, data, timeout) File "/usr/lib64/python2.7/urllib2.py", line 437, in open response = meth(req, response) File "/usr/lib64/python2.7/urllib2.py", line 550, in http_response 'http', request, response, code, msg, hdrs) File "/usr/lib64/python2.7/urllib2.py", line 469, in error result = self._call_chain(args) File "/usr/lib64/python2.7/urllib2.py", line 409, in _call_chain result = func(args) File "/usr/lib64/python2.7/urllib2.py", line 656, in http_error_302 return self.parent.open(new, timeout=req.timeout) File "/usr/lib64/python2.7/urllib2.py", line 437, in open response = meth(req, response) File "/usr/lib64/python2.7/urllib2.py", line 550, in http_response 'http', request, response, code, msg, hdrs) File "/usr/lib64/python2.7/urllib2.py", line 475, in error return self._call_chain(args) File "/usr/lib64/python2.7/urllib2.py", line 409, in _call_chain result = func(args) File "/usr/lib64/python2.7/urllib2.py", line 558, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 503: Service Unavailable

On 05/14/2017 04:37 PM, Olivier Hagolle wrote:

Well, still Error 503, service unavailable Strange.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/olivierhagolle/LANDSAT-Download/issues/39#issuecomment-301338273, or mute the thread https://github.com/notifications/unsubscribe-auth/AGQL93VrDx27kvjR17nacFgigBDigybyks5r52YEgaJpZM4NWryr.

-- Brock Murch Senior Systems Administrator College of Marine Science University of South Florida

Opadera commented 7 years ago

same here

olivierhagolle commented 7 years ago

I must have done somthing wrong with git and started my modifications for collections from an older version. Leave me a few minutes to test it a little more Olivier

olivierhagolle commented 7 years ago

Done, works at least for Landsat 8 and collection 1

Opadera commented 7 years ago

can confirm it works. Thanks a lot!

bmurch commented 7 years ago

Awesome,

Works here too. FYI, if you want to see how i use it:

http://optics.marine.usf.edu/cgi-bin/ls?roi=MARTINIQUE&current=1

http://optics.marine.usf.edu/cgi-bin/ls?roi=GUADELOUPE&current=1

I know researchers in the Carib that rely on this raw data.

Thanks so much.

B

On 05/19/2017 05:46 AM, unnic wrote:

can confirm it works. Thanks a lot!

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/olivierhagolle/LANDSAT-Download/issues/39#issuecomment-302659085, or mute the thread https://github.com/notifications/unsubscribe-auth/AGQL95hHzaTUAhg7PZrPxRJ9BJXW9YzKks5r7WTogaJpZM4NWryr.

-- Brock Murch Senior Systems Administrator College of Marine Science University of South Florida

olivierhagolle commented 7 years ago

I had a look, nice real time products ! You do your own atmospheric correction ?

I am really happy to know this is useful. On our side, we use that software to fuel our Theia processing center, that provides atmospheric corrected products and cloud masks (aiming at land monitoring rather than ocean)

We are also processing guadeloupe and Martinique ;) https://theia-landsat.cnes.fr/rocket/#/search?page=1&q=guadeloupe&collection=Landsat

And we are going to do the same with Sentinel-2 : but we started with sites in Europe and Africa. https://theia.cnes.fr