search

sat-utils / sat-api

One API to search public satellites metadata on AWS
https://sat-api.developmentseed.org/search/stac
MIT License
177 stars 20 forks source link

Heroku Application Error #197

Closed tonybutzer closed 4 years ago

tonybutzer commented 5 years ago

image

tonybutzer@gmail.com

vincentsarago commented 5 years ago

@tonybutzer the correct url should be https://sat-api.developmentseed.org/stac/search. I agree the error message is not 👌

tonybutzer commented 5 years ago

thanks

I am getting the same sort of error in a jupyter notebook and so I was reviewing the docs in the github and it pointed me to that url - thanks for the quick response - I may ask for help when I can better isolate my notebook error.

-tony

On Thu, Sep 19, 2019 at 8:24 AM Vincent Sarago notifications@github.com wrote:

@tonybutzer https://github.com/tonybutzer the correct url should be https://sat-api.developmentseed.org/stac/search. I agree the error message is not 👌

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/sat-utils/sat-api/issues/197?email_source=notifications&email_token=AFLEWNPRO4C3LOHHKPUSKVTQKN4SFA5CNFSM4IYLA6HKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD7DOOPA#issuecomment-533129020, or mute the thread https://github.com/notifications/unsubscribe-auth/AFLEWNOCO7K7KDKFS6BCW4DQKN4SFANCNFSM4IYLA6HA .

--

Tony Butzer ODC Cloud Engineer KBR Contractor to the U.S. Geological Survey (USGS)

Phone: (605) 254-7112 Email: tonybutzer@gmail.com

tonybutzer commented 5 years ago

attached is the html output from running this notebook

https://github.com/tonybutzer/notebook/blob/master/anotebooks/10-debug-notebooks/00-sat-search-test.ipynb

The above is a simple replica of the sat-search tutorial.

I am seeing failures on almost every run - Are you guys seeing these same failures?

-tony

On Thu, Sep 19, 2019 at 8:54 AM Tony Butzer tonybutzer@gmail.com wrote:

thanks

I am getting the same sort of error in a jupyter notebook and so I was reviewing the docs in the github and it pointed me to that url - thanks for the quick response - I may ask for help when I can better isolate my notebook error.

-tony

On Thu, Sep 19, 2019 at 8:24 AM Vincent Sarago notifications@github.com wrote:

@tonybutzer https://github.com/tonybutzer the correct url should be https://sat-api.developmentseed.org/stac/search. I agree the error message is not 👌

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/sat-utils/sat-api/issues/197?email_source=notifications&email_token=AFLEWNPRO4C3LOHHKPUSKVTQKN4SFA5CNFSM4IYLA6HKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD7DOOPA#issuecomment-533129020, or mute the thread https://github.com/notifications/unsubscribe-auth/AFLEWNOCO7K7KDKFS6BCW4DQKN4SFANCNFSM4IYLA6HA .

--

Tony Butzer ODC Cloud Engineer KBR Contractor to the U.S. Geological Survey (USGS)

Phone: (605) 254-7112 Email: tonybutzer@gmail.com

--

Tony Butzer ODC Cloud Engineer KBR Contractor to the U.S. Geological Survey (USGS)

Phone: (605) 254-7112 Email: tonybutzer@gmail.com

matthewhanson commented 5 years ago

Hi @tonybutzer thanks for bringing this up.

The API URL that should be set for sat-search (with the SATUTILS_API_URL environment variable) is the root URL of the API, so in this case https://sat-api.developmentseed.org sat-search will automatically use the correct search endpoint. Not sure if that's your problem or not.

I'm about to make some minor updates to sat-search to use sat-stac 0.2, and I'll run through the tutorial and see if I can replicate.

tonybutzer commented 5 years ago

oot@9a74655ebac4:~# sat-search search -p "collection=landsat-8-l1" --datetime 2018 685 items found root@9a74655ebac4:~# sat-search search -p "collection=landsat-8-l1" --datetime 2018 Traceback (most recent call last): File "/usr/local/bin/sat-search", line 11, in sys.exit(cli()) File "/usr/local/lib/python3.5/dist-packages/satsearch/main.py", line 65, in cli main(kwargs) File "/usr/local/lib/python3.5/dist-packages/satsearch/main.py", line 23, in main items = search.items() File "/usr/local/lib/python3.5/dist-packages/satsearch/search.py", line 116, in items found = self.found() File "/usr/local/lib/python3.5/dist-packages/satsearch/search.py", line 74, in found results = self.query(kwargs) File "/usr/local/lib/python3.5/dist-packages/satsearch/search.py", line 84, in query raise SatSearchError(response.text) satsearch.search.SatSearchError: <!DOCTYPE html>

Application Error

On Thu, Sep 19, 2019 at 12:16 PM Matthew Hanson notifications@github.com wrote:

Hi @tonybutzer https://github.com/tonybutzer thanks for bringing this up.

The API URL that should be set for sat-search (with the SATUTILS_API_URL environment variable) is the root URL of the API, so in this case https://sat-api.developmentseed.org sat-search will automatically use the correct search endpoint. Not sure if that's your problem or not.

I'm about to make some minor updates to sat-search to use sat-stac 0.2, and I'll run through the tutorial and see if I can replicate.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/sat-utils/sat-api/issues/197?email_source=notifications&email_token=AFLEWNJXFRVWI4P2BUQHSWTQKOXWVA5CNFSM4IYLA6HKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD7EGICY#issuecomment-533226507, or mute the thread https://github.com/notifications/unsubscribe-auth/AFLEWNP6LIL5YNACPR45Y73QKOXWVANCNFSM4IYLA6HA .

--

Tony Butzer ODC Cloud Engineer KBR Contractor to the U.S. Geological Survey (USGS)

Phone: (605) 254-7112 Email: tonybutzer@gmail.com

matthewhanson commented 5 years ago

So this is an intermittent error, it seems like it's something with your deployment of sat-api. You aren't seeing this problem with either of these are you?

https://sat-api.developmentseed.org https://earth-search.aws.element84.com

tonybutzer commented 5 years ago

tony@jose ~ $ sat-search search -p "collection=landsat-8-l1" --datetime 2018 --url https://sat-api.developmentseed.org 685 items found tony@jose ~ $ sat-search search -p "collection=landsat-8-l1" --datetime 2018 --url https://sat-api.developmentseed.org 685 items found tony@jose ~ $ sat-search search -p "collection=landsat-8-l1" --datetime 2018 --url https://sat-api.developmentseed.org 685 items found tony@jose ~ $ sat-search search -p "collection=landsat-8-l1" --datetime 2018 --url https://sat-api.developmentseed.org 685 items found tony@jose ~ $ sat-search search -p "collection=landsat-8-l1" --datetime 2018 --url https://sat-api.developmentseed.org 685 items found tony@jose ~ $ sat-search search -p "collection=landsat-8-l1" --datetime 2018 --url https://sat-api.developmentseed.org Traceback (most recent call last): File "/usr/local/bin/sat-search", line 11, in load_entry_point('sat-search==0.2.1', 'console_scripts', 'sat-search')() File "/usr/local/lib/python3.5/dist-packages/satsearch/main.py", line 65, in cli main(kwargs) File "/usr/local/lib/python3.5/dist-packages/satsearch/main.py", line 23, in main items = search.items() File "/usr/local/lib/python3.5/dist-packages/satsearch/search.py", line 126, in items items += [Item(i) for i in self.query(kwargs)['features']] File "/usr/local/lib/python3.5/dist-packages/satsearch/search.py", line 84, in query raise SatSearchError(response.text) satsearch.search.SatSearchError: <!DOCTYPE html>

Application Error

tony@jose ~ $

New Install - different machine - linux debian/ubuntu/mint box - different network provider --url https://sat-api.developmentseed.org

On Thu, Sep 19, 2019 at 12:52 PM Matthew Hanson notifications@github.com wrote:

So this is an intermittent error, it seems like it's something with your deployment of sat-api. You aren't seeing this problem with either of these are you?

https://sat-api.developmentseed.org https://earth-search.aws.element84.com

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/sat-utils/sat-api/issues/197?email_source=notifications&email_token=AFLEWNKHURSF5DEB5GHOHALQKO347A5CNFSM4IYLA6HKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD7EJNUI#issuecomment-533239505, or mute the thread https://github.com/notifications/unsubscribe-auth/AFLEWNPHOUOBF77YZSTGLADQKO347ANCNFSM4IYLA6HA .

--

Tony Butzer ODC Cloud Engineer KBR Contractor to the U.S. Geological Survey (USGS)

Phone: (605) 254-7112 Email: tonybutzer@gmail.com

matthewhanson commented 5 years ago

Hmm, I wonder if it's respecting the URL, as the error says heroku, and sat-api isn't deployed on heroku. Maybe it's still using your other endpoint?

You can run sat-search with the -v command. -v 4 I think should print up additional debug info, such as the endpoints when it makes request.

Also, you can use the --found option, that will just make a request to get total number of hits, and won't get the results, which can be faster if just seeing if there are hits.

matthewhanson commented 5 years ago

Ok, I finally got around to trying this out, and I am also getting this error, and I find it very confusing because last I knew sat-api was not using heroku, it's deployed on AWS and uses API Gateway.

Will revisit this tomorrow and figure it out. @tonybutzer you can also try https://earth-search.aws.element84.com, it doesn't have the complete historical archive of landsat and sentinel yet, but should have everything from the last 6 months (plus CBERS-4 data).

tonybutzer commented 5 years ago

Thanks Matt

I will try the element84 path as well - happy bug hunting.

-tony

On Thu, Sep 19, 2019 at 10:14 PM Matthew Hanson notifications@github.com wrote:

Ok, I finally got around to trying this out, and I am also getting this error, and I find it very confusing because last I knew sat-api was not using heroku, it's deployed on AWS and uses API Gateway.

Will revisit this tomorrow and figure it out. @tonybutzer https://github.com/tonybutzer you can also try https://earth-search.aws.element84.com, it doesn't have the complete historical archive of landsat and sentinel yet, but should have everything from the last 6 months (plus CBERS-4 data).

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/sat-utils/sat-api/issues/197?email_source=notifications&email_token=AFLEWNLWU3HEYWA67HQ6IPLQKQ52VA5CNFSM4IYLA6HKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD7FNRUI#issuecomment-533387473, or mute the thread https://github.com/notifications/unsubscribe-auth/AFLEWNO7HA6VXBQZEOJNLMTQKQ52VANCNFSM4IYLA6HA .

--

Tony Butzer ODC Cloud Engineer KBR Contractor to the U.S. Geological Survey (USGS)

Phone: (605) 254-7112 Email: tonybutzer@gmail.com

matthewhanson commented 5 years ago

@tonybutzer I think this might have been resolved? I think it was an issue with how the domain was being hosted.

nicartograph commented 5 years ago

Hi there. I have now the same issue during search.items() Is it a temporary problem? UPD: Yes, temporary.

matthewhanson commented 4 years ago

This was due to intermittent issues with DevSeed's hosting of sat-api.developmentseed.org, closing