nansencenter / sentinel1denoised

Thermal noise subtraction, scalloping correction, angular correction
GNU General Public License v3.0
39 stars 14 forks source link

Error while trying to denoise EW_GRDM_1SDH product #103

Open Venkatakrishnan-M opened 4 months ago

Venkatakrishnan-M commented 4 months ago

I have Sentinel 1 product named S1A_EW_GRDM_1SDH_20240213T121327_20240213T121427_052540_065ADF_F9D6.SAFE.zip

When I try to open this file using the code below I am getting Valuerror.

from s1denoise import Sentinel1Image
# open access to file with S1 data
input_file = "C:\\Users\\venka\\Desktop\\S1A_EW_GRDM_1SDH_20240213T121327_20240213T121427_052540_065ADF_F9D6.SAFE.zip"
s1 = Sentinel1Image(input_file)

Error message : image

I am sure that the product I use is S1A_EW_GRDM_1SDH. Can someone explain why valueError is raised ?

XiaosongZhang commented 3 months ago

I had the same problem, not sure what triggered it, have you solved it yet?

akorosov commented 3 months ago

Hi! Can you try to unzip the file and run processing?

Venkatakrishnan-M commented 3 months ago

Hi! Can you try to unzip the file and run processing? @akorosov Hi! I have tried doing it but the problem is not solved. I opened the source code and commented out the raise valueError statement, and it worked like magic the problem got solved.

Venkatakrishnan-M commented 3 months ago

I had the same problem, not sure what triggered it, have you solved it yet?

Hi @XiaosongZhang. I opened the source code and commented out the raise valueError statement. The problem got solved.

XiaosongZhang commented 3 months ago

I tried unzip and commenting the raise valueError statement but none of them got solved, I tried adopting multiple data, some of them work fine but some of them get the error as shown below, I suspect it's a problem with the data and it's not solved yet: Traceback (most recent call last): File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\connectionpool.py", line 700, in urlopen self._prepare_proxy(conn) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\connectionpool.py", line 994, in _prepare_proxy conn.connect() File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\connection.py", line 364, in connect conn = self._connect_tls_proxy(hostname, conn) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\connection.py", line 507, in _connect_tls_proxy ssl_context=sslcontext, File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\util\ssl.py", line 453, in ssl_wrap_socket ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_intls) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\util\ssl.py", line 495, in _ssl_wrap_socket_impl return ssl_context.wrap_socket(sock) File "C:\Users\Dell.conda\envs\s1denoise\lib\ssl.py", line 407, in wrap_socket _context=self, _session=session) File "C:\Users\Dell.conda\envs\s1denoise\lib\ssl.py", line 814, in init self.do_handshake() File "C:\Users\Dell.conda\envs\s1denoise\lib\ssl.py", line 1068, in do_handshake self._sslobj.do_handshake() File "C:\Users\Dell.conda\envs\s1denoise\lib\ssl.py", line 689, in do_handshake self._sslobj.do_handshake() ssl.SSLEOFError: EOF occurred in violation of protocol (_ssl.c:777)

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\requests\adapters.py", line 450, in send timeout=timeout File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\connectionpool.py", line 786, in urlopen method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2] File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\util\retry.py", line 592, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='sar-mpc.eu', port=443): Max retries exceeded with url: /api/v1/?product_type=AUX_CAL&validity_start=2015-07-22T12:00:00&creation_date=2015-11-25T10:47:33 (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:777)'),))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\s1denoise\sentinel1image.py", line 104, in download_aux_calibration remote_url, physical_name = get_remote_url(f'https://sar-mpc.eu/api/v1/?product_type=AUX_CAL&validity_start={validity_start}&creation_date={creation_date}') File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\s1denoise\sentinel1image.py", line 98, in get_remote_url with requests.get(api_url, stream=True) as r: File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\requests\api.py", line 75, in get return request('get', url, params=params, kwargs) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\requests\api.py", line 61, in request return session.request(method=method, url=url, kwargs) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\requests\sessions.py", line 529, in request resp = self.send(prep, send_kwargs) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\requests\sessions.py", line 645, in send r = adapter.send(request, kwargs) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\requests\adapters.py", line 517, in send raise SSLError(e, request=request) requests.exceptions.SSLError: HTTPSConnectionPool(host='sar-mpc.eu', port=443): Max retries exceeded with url: /api/v1/?product_type=AUX_CAL&validity_start=2015-07-22T12:00:00&creation_date=2015-11-25T10:47:33 (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:777)'),))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\connectionpool.py", line 700, in urlopen self._prepare_proxy(conn) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\connectionpool.py", line 994, in _prepare_proxy conn.connect() File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\connection.py", line 364, in connect conn = self._connect_tls_proxy(hostname, conn) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\connection.py", line 507, in _connect_tls_proxy ssl_context=sslcontext, File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\util\ssl.py", line 453, in ssl_wrap_socket ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_intls) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\util\ssl.py", line 495, in _ssl_wrap_socket_impl return ssl_context.wrap_socket(sock) File "C:\Users\Dell.conda\envs\s1denoise\lib\ssl.py", line 407, in wrap_socket _context=self, _session=session) File "C:\Users\Dell.conda\envs\s1denoise\lib\ssl.py", line 814, in init self.do_handshake() File "C:\Users\Dell.conda\envs\s1denoise\lib\ssl.py", line 1068, in do_handshake self._sslobj.do_handshake() File "C:\Users\Dell.conda\envs\s1denoise\lib\ssl.py", line 689, in do_handshake self._sslobj.do_handshake() ssl.SSLEOFError: EOF occurred in violation of protocol (_ssl.c:777)

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\requests\adapters.py", line 450, in send timeout=timeout File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\connectionpool.py", line 786, in urlopen method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2] File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\urllib3\util\retry.py", line 592, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='sar-mpc.eu', port=443): Max retries exceeded with url: /api/v1/?product_type=AUX_CAL&validity_start=2015-07-22T12:00:00 (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:777)'),))

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "E:/PycharmProjects/pythonProject/denoise test.py", line 10, in s1 = Sentinel1Image(input_file) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\s1denoise\sentinel1image.py", line 160, in init self.xml = Sentinel1ImageXml(self) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\s1denoise\sentinel1image.py", line 77, in init self.download_aux_calibration(auxCalibFilename) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\s1denoise\sentinel1image.py", line 106, in download_aux_calibration remote_url, physical_name = get_remote_url(f'https://sar-mpc.eu/api/v1/?product_type=AUX_CAL&validity_start={validity_start}') File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\s1denoise\sentinel1image.py", line 98, in get_remote_url with requests.get(api_url, stream=True) as r: File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\requests\api.py", line 75, in get return request('get', url, params=params, kwargs) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\requests\api.py", line 61, in request return session.request(method=method, url=url, kwargs) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\requests\sessions.py", line 529, in request resp = self.send(prep, send_kwargs) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\requests\sessions.py", line 645, in send r = adapter.send(request, kwargs) File "C:\Users\Dell.conda\envs\s1denoise\lib\site-packages\requests\adapters.py", line 517, in send raise SSLError(e, request=request) requests.exceptions.SSLError: HTTPSConnectionPool(host='sar-mpc.eu', port=443): Max retries exceeded with url: /api/v1/?product_type=AUX_CAL&validity_start=2015-07-22T12:00:00 (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:777)'),))

akorosov commented 3 months ago

Can you try access the problematic URL from your browser: https://sar-mpc.eu/api/v1/?product_type=AUX_CAL&validity_start=2015-07-22T12:00:00

I can access it. And you?