search

tracek / gee_asset_manager

Google Earth Engine Batch Asset Manager
Apache License 2.0
74 stars 35 forks source link

Error: incorrect credentials #51

Open jdilger opened 6 years ago

jdilger commented 6 years ago

Hey there,

I am trying to batch upload some tifs with metadata in a virtualenv and have an Incorrect Credentials error. I have tried it with both installed, and from the gee_asset_manger folder. My email and password are correct, and I can initialize. Any thoughts or help is appreciated.

Cheers, J

2018-10-06 02:42:46,357 :: root :: INFO :: New collection users/TEST/puyo2 created 2018-10-06 02:42:47,816 :: root :: INFO :: Processing image 1 out of 131: /home/bschwert/puyo/tif/20150217_040D_RTC.dat_RsNear_Gamma0_VV.tif 2018-10-06 02:42:48,376 :: root :: ERROR :: Incorrect credentials. Probably. If you are sure the credentials are OK, refresh the authentication token. If it did not work report a p roblem. They might have changed something in the Matrix.

BigBroken commented 6 years ago

I'm also having the same error after putting in the correct credentials.

2018-10-11 19:50:49,681 :: root :: ERROR :: Incorrect credentials. Probably. If you are sure the credentials are OK, refresh the authentication token. If it did not work report a problem. They might have changed something in the Matrix.

Did basic check of signing into browser, that two step verification is off, and verified I could access google earth engine via python terminal. Starting to think something might have changed in the google matrix.

edtrochim commented 6 years ago

I am also having the same problem. I also checked that my two-step verification is off, that I've allowed less secure apps to have access and tried two different accounts. I've also tried multiple times on different days.

duribef commented 5 years ago

Hi everyone, i'm in the same situation, any news?

KMarkert commented 5 years ago

I am having the same issue as well. Tried uploading data using different accounts and in a Python 2.7 and Python 3.6 environment with no luck. It seems the use is coming from bath_uploader.py in the __get_upload_url function where the response from the url response isn't matching what is expected. Specifically, the ast.literal_eval() is failing.

imantantawy commented 5 years ago

hi Everyone, I'm facing the same issue. Any news or updates on this?

maosi-chen commented 5 years ago

Same problem as of February 11, 2019. It seems that we need to upload images to GEE from Google Cloud Storage (expensive!) in the future? https://gis.stackexchange.com/questions/303346/code-earthengine-uploading-multiple-images-ingestion-failed-time-out/303414#303414

ezangakis commented 5 years ago

Having the same issue in March 2019.... Anyone try contacting the author of the code? I have a feeling @chenmaosi is probably right and that this method may be blocked from Google to force a paywall for GCS. They recently shut down the Fusion table service as well

imantantawy commented 5 years ago

Hey, I have a solution! Try using https://github.com/samapriya/geeup. It's an edited version and worked for me. Good luck!

tracek commented 5 years ago

Sorry everyone for the silence, it's been a while. Long story short, a combination of private, professional and medical reasons, I did not mean to abandon the project. I got a signal that mentioned by @imantantawy geeup is currently broken. I tried uploading some tiffs but no luck due to a few bugs. Even if these were fixed, the program does not account for 2 factor authentication (2FA), which is pretty much mandatory for me nowadays.

I'd like to fix geebam so that it works with 2FA under various platforms, without imposing unnecessary requirements. I already have a quick fix, but it will take me a few days to test it under different OS and browsers. Currently I tested the fix to the limited extent on Linux and Chrome. It might work under different OS, although other browsers are not yet implemented.

Why browser is important? Because that's the way to authenticate nowadays, I don't see a way around it unless Google provides API.

My question to you (assuming you're still interested!) @imantantawy @ezangakis @chenmaosi @KMarkert @duribef @jdilger @BigBroken and anyone else: what operating system and browser(s) are you using? Eventually I'd like to support Linux, MacOS and Windows with Chrome, Firefox and Edge. That being said, I'd be happy to prioritise setup that you have, assuming you'd be willing to give it a test drive.

Cheers, Lukasz

samapriya commented 5 years ago

Hi @tracek Excited to see you are back :) I pushed more updates to geeup now at v0.3.2 and uploaded about 2000 tif files today. In fact, geeup has been using the selenium method (though using the firefox drivers instead of chrome) since the beginning to allow for uploads based on the basic design from geebam apart from adding additional tools. Also excited to see the 2FA implementation with the headless state in selenium. Do you think this would be possible with selenium in a headless setup on servers without Displays? As always looking forward to learning more :)

tracek commented 5 years ago

Hi @samapriya ! Good to hear that it's fixed.

One of the points of having headless setup is exactly to run on the server side. There is a catch though: currently 2FA will work only if Authenticator app is used. Auth with phone code? That would require extra piece of code to handle. I might add it should there be interest in it. Mind tha Google will turn off approval via Authenticator if there are "too many" requests sent, so it makes some sense.