asfadmin / Discovery-asf_search

BSD 3-Clause "New" or "Revised" License
126 stars 43 forks source link

[Bug] Specific datetime fails search queries on sentinel-1 #245

Closed probinso closed 6 months ago

probinso commented 9 months ago

Describe the bug

asf_search.exceptions.ASFSearch4xxError thrown when asf.search(platform=asf.SENTINEL1, start=start, end=end) spans datetime.datetime(year=2021, month=12, day=7, hour=10, minute=55)

To Reproduce Steps to reproduce the behavior:


import pytest
from datetime import datetime, timedelta
import asf_search as asf

# I'm located in Portland Oregon, which may effect time localization
START = datetime.utcfromtimestamp(1638864000)
DT = timedelta(days=1)

ASF_MAGIC_BUG_DATE = datetime.utcfromtimestamp(1638864000) + timedelta(hours=2, minutes=55)

@pytest.mark.commit
def test_sentinel_1_all():
    end = START + DT
    asf.search(
        platform=asf.SENTINEL1, start=START, end=end
    )

@pytest.mark.commit
def test_sentinel_1_split():
    end = START + DT
    asf.search(
        platform=asf.SENTINEL1, start=START, end=ASF_MAGIC_BUG_DATE
    )
    asf.search(platform=asf.SENTINEL1B, start=ASF_MAGIC_BUG_DATE, end=end)

@pytest.mark.commit
def test_sentinel_1_split_2():
    end = START + DT
    asf.search(
        platform=asf.SENTINEL1, start=START, end=ASF_MAGIC_BUG_DATE
    )
    asf.search(platform=asf.SENTINEL1A, start=ASF_MAGIC_BUG_DATE, end=end)

@pytest.mark.commit
def test_sentinel_1_all_2():
    start = START + DT
    end = start + DT
    asf.search(
        platform=asf.SENTINEL1, start=start, end=end
    )

Expected behavior This search should complete without throwing an error

Desktop (please complete the following information):

Running on Mac OSX

% uname -a
Darwin Philips-MBP.hsd1.or.comcast.net 22.5.0 Darwin Kernel Version 22.5.0: Mon Apr 24 20:52:24 PDT 2023; root:xnu-8796.121.2~5/RELEASE_ARM64_T6000 arm64
(gfwsat-dev) philiprobinson@Philips-MBP gfwsat % python --version
Python 3.10.11
(gfwsat-dev) philiprobinson@Philips-MBP gfwsat % pip freeze
affine @ file:///Users/ktietz/demo/mc3/conda-bld/affine_1629890479180/work
aiohttp @ file:///Users/runner/miniforge3/conda-bld/aiohttp_1686375944694/work
aiosignal @ file:///home/conda/feedstock_root/build_artifacts/aiosignal_1667935791922/work
-e git+ssh://git@github.com/probinso/antimeridian_splitter.git@139822244014b156c013d05128afe722aeec626c#egg=antimeridian_splitter
anyio @ file:///home/conda/feedstock_root/build_artifacts/anyio_1685486400275/work/dist
appdirs==1.4.4
appnope @ file:///home/conda/feedstock_root/build_artifacts/appnope_1649077682618/work
argcomplete @ file:///home/conda/feedstock_root/build_artifacts/argcomplete_1686587382193/work
argon2-cffi @ file:///home/conda/feedstock_root/build_artifacts/argon2-cffi_1640817743617/work
argon2-cffi-bindings @ file:///Users/runner/miniforge3/conda-bld/argon2-cffi-bindings_1666850813776/work
arrow==1.2.3
asciitree==0.3.3
asf-search==5.0.2
asttokens @ file:///home/conda/feedstock_root/build_artifacts/asttokens_1670263926556/work
async-lru==2.0.2
async-timeout @ file:///home/conda/feedstock_root/build_artifacts/async-timeout_1640026696943/work
attrs @ file:///home/conda/feedstock_root/build_artifacts/attrs_1683424013410/work
autobahn==23.6.1
Automat==22.10.0
Babel==2.12.1
backcall @ file:///home/conda/feedstock_root/build_artifacts/backcall_1592338393461/work
backports.functools-lru-cache @ file:///home/conda/feedstock_root/build_artifacts/backports.functools_lru_cache_1618230623929/work
beautifulsoup4 @ file:///home/conda/feedstock_root/build_artifacts/beautifulsoup4_1680888073205/work
black==22.12.0
bleach @ file:///home/conda/feedstock_root/build_artifacts/bleach_1674535352125/work
blessed==1.20.0
blinker @ file:///home/conda/feedstock_root/build_artifacts/blinker_1681349778161/work
bpython==0.24
branca @ file:///home/conda/feedstock_root/build_artifacts/branca_1667848736831/work
cachetools @ file:///home/conda/feedstock_root/build_artifacts/cachetools_1674482203741/work
Cartopy @ file:///Users/runner/miniforge3/conda-bld/cartopy_1670926209927/work
certifi @ file:///private/var/folders/k1/30mswbxs7r1g6zwn8y4fyt500000gp/T/abs_3bweqb8byn/croot/certifi_1690232244779/work/certifi
cffi @ file:///Users/runner/miniforge3/conda-bld/cffi_1671179893800/work
cfgv==3.3.1
charset-normalizer @ file:///home/conda/feedstock_root/build_artifacts/charset-normalizer_1678108872112/work
click @ file:///home/conda/feedstock_root/build_artifacts/click_1666798198223/work
click-plugins==1.1.1
cligj @ file:///home/conda/feedstock_root/build_artifacts/cligj_1633637764473/work
cmocean==2.0
colorama @ file:///home/conda/feedstock_root/build_artifacts/colorama_1666700638685/work
colorspacious==1.1.2
comm @ file:///home/conda/feedstock_root/build_artifacts/comm_1679481329611/work
constantly==15.1.0
coverage==7.2.7
cryptography @ file:///Users/runner/miniforge3/conda-bld/cryptography-split_1685659597707/work
curtsies==0.4.1
cwcwidth==0.1.8
cycler @ file:///home/conda/feedstock_root/build_artifacts/cycler_1635519461629/work
darglint==1.8.1
dataclass-type-validator==0.1.2
dataclasses-json==0.5.8
dateparser==1.1.8
db-dtypes @ file:///home/conda/feedstock_root/build_artifacts/db-dtypes_1680245382075/work
debugpy @ file:///Users/runner/miniforge3/conda-bld/debugpy_1680755676047/work
decorator @ file:///home/conda/feedstock_root/build_artifacts/decorator_1641555617451/work
defusedxml @ file:///home/conda/feedstock_root/build_artifacts/defusedxml_1615232257335/work
distlib==0.3.6
dparse==0.6.2
entrypoints @ file:///home/conda/feedstock_root/build_artifacts/entrypoints_1643888246732/work
ephem==4.1.4
exceptiongroup @ file:///home/conda/feedstock_root/build_artifacts/exceptiongroup_1678703645500/work
executing @ file:///home/conda/feedstock_root/build_artifacts/executing_1667317341051/work
fastavro @ file:///Users/runner/miniforge3/conda-bld/fastavro_1683226863489/work
fasteners @ file:///home/conda/feedstock_root/build_artifacts/fasteners_1643971550063/work
fastjsonschema @ file:///home/conda/feedstock_root/build_artifacts/python-fastjsonschema_1684761244589/work/dist
filelock==3.12.2
Fiona @ file:///Users/runner/miniforge3/conda-bld/fiona_1671017708511/work
flake8==6.0.0
Flask==2.3.2
flit_core @ file:///home/conda/feedstock_root/build_artifacts/flit-core_1684084314667/work/source/flit_core
folium @ file:///home/conda/feedstock_root/build_artifacts/folium_1670956290671/work
fqdn==1.5.1
frozenlist @ file:///Users/runner/miniforge3/conda-bld/frozenlist_1667935502123/work
fsspec @ file:///home/conda/feedstock_root/build_artifacts/fsspec_1668082755814/work
ftpretty==0.4.0
gcsfs @ file:///home/conda/feedstock_root/build_artifacts/gcsfs_1668089545087/work
GDAL @ file:///Users/runner/miniforge3/conda-bld/gdal-split_1670808086647/work/build/swig/python
geographiclib==2.0
geojson==3.0.1
geomet==1.0.0
geopandas @ file:///home/conda/feedstock_root/build_artifacts/geopandas_1686057576800/work
geopy==2.3.0
geos==0.2.3
-e git+ssh://git@github.com/GlobalFishingWatch/gfwsat.git@288e693743dd159deb6ac626e353688965f87ed2#egg=gfwsat
Glymur @ file:///home/conda/feedstock_root/build_artifacts/glymur_1669641175421/work
google-api-core @ file:///home/conda/feedstock_root/build_artifacts/google-api-core-split_1665207588296/work
google-api-python-client @ file:///home/conda/feedstock_root/build_artifacts/google-api-python-client_1685447681973/work
google-auth==2.6.6
google-auth-httplib2 @ file:///home/conda/feedstock_root/build_artifacts/google-auth-httplib2_1654134467987/work
google-auth-oauthlib==0.5.2
google-cloud==0.34.0
google-cloud-bigquery==3.3.6
google-cloud-bigquery-storage @ file:///home/conda/feedstock_root/build_artifacts/google-cloud-bigquery-storage-split_1642183604146/work
google-cloud-core @ file:///home/conda/feedstock_root/build_artifacts/google-cloud-core_1658759191372/work
google-cloud-storage==2.9.0
google-crc32c @ file:///Users/runner/miniforge3/conda-bld/google-crc32c_1666827019506/work
google-resumable-media==2.3.3
googleapis-common-protos==1.56.4
greenlet==2.0.2
grpcio @ file:///Users/runner/miniforge3/conda-bld/grpc-split_1684119215020/work
grpcio-status @ file:///home/conda/feedstock_root/build_artifacts/grpcio-status_1683994707350/work
h11==0.14.0
h3==3.7.6
haversine @ file:///home/conda/feedstock_root/build_artifacts/haversine_1662299098807/work
hkdf==0.0.3
html2text==2020.1.16
httpcore==0.17.3
httplib2 @ file:///home/conda/feedstock_root/build_artifacts/httplib2_1679483503307/work
httpx==0.24.1
humanize==4.6.0
hyperlink==21.0.0
identify==2.5.24
idna @ file:///home/conda/feedstock_root/build_artifacts/idna_1663625384323/work
imageio==2.31.1
imgkit==1.2.3
importlib-metadata @ file:///home/conda/feedstock_root/build_artifacts/importlib-metadata_1682176699712/work
importlib-resources @ file:///home/conda/feedstock_root/build_artifacts/importlib_resources_1676919000169/work
incremental==22.10.0
iniconfig==2.0.0
ipykernel @ file:///Users/runner/miniforge3/conda-bld/ipykernel_1684162997309/work
ipython @ file:///Users/runner/miniforge3/conda-bld/ipython_1685727999785/work
ipython-genutils==0.2.0
ipywidgets @ file:///home/conda/feedstock_root/build_artifacts/ipywidgets_1655973868664/work
isoduration==20.11.0
itsdangerous==2.1.2
jedi @ file:///home/conda/feedstock_root/build_artifacts/jedi_1669134318875/work
Jinja2 @ file:///home/conda/feedstock_root/build_artifacts/jinja2_1654302431367/work
jinja2-cli==0.8.2
joblib @ file:///home/conda/feedstock_root/build_artifacts/joblib_1663332044897/work
json5==0.9.14
jsonpointer==2.3
jsonschema @ file:///home/conda/feedstock_root/build_artifacts/jsonschema-meta_1669810440410/work
jupyter==1.0.0
jupyter-console==6.6.3
jupyter-events @ file:///home/conda/feedstock_root/build_artifacts/jupyter_events_1673559782596/work
jupyter-lsp==2.2.0
jupyter_client @ file:///home/conda/feedstock_root/build_artifacts/jupyter_client_1681432441054/work
jupyter_core @ file:///Users/runner/miniforge3/conda-bld/jupyter_core_1678994238709/work
jupyter_server @ file:///home/conda/feedstock_root/build_artifacts/jupyter_server_1685051725700/work
jupyter_server_terminals @ file:///home/conda/feedstock_root/build_artifacts/jupyter_server_terminals_1673491454549/work
jupyterlab==4.0.2
jupyterlab-pygments @ file:///home/conda/feedstock_root/build_artifacts/jupyterlab_pygments_1649936611996/work
jupyterlab-widgets @ file:///home/conda/feedstock_root/build_artifacts/jupyterlab_widgets_1680041524590/work
jupyterlab_server==2.22.1
jupytext==1.14.6
kiwisolver @ file:///Users/runner/miniforge3/conda-bld/kiwisolver_1666805765141/work
kml2geojson==5.1.0
LatLon==1.0.2
lazy_loader==0.2
libcst @ file:///Users/runner/miniforge3/conda-bld/libcst_1686240048692/work
Logbook==1.5.3
lxml @ file:///Users/runner/miniforge3/conda-bld/lxml_1671013522951/work
magic-wormhole==0.12.0
mapclassify @ file:///home/conda/feedstock_root/build_artifacts/mapclassify_1673861555770/work
markdown-it-py==2.2.0
MarkupSafe @ file:///Users/runner/miniforge3/conda-bld/markupsafe_1685769224421/work
marshmallow==3.19.0
marshmallow-enum==1.5.1
matplotlib @ file:///Users/runner/miniforge3/conda-bld/matplotlib-suite_1636786736839/work
matplotlib-inline @ file:///home/conda/feedstock_root/build_artifacts/matplotlib-inline_1660814786464/work
mccabe==0.7.0
mdit-py-plugins==0.4.0
mdurl==0.1.2
mistune @ file:///home/conda/feedstock_root/build_artifacts/mistune_1675771498296/work
mpmath==1.3.0
msgpack @ file:///Users/runner/miniforge3/conda-bld/msgpack-python_1678312968551/work
multidict @ file:///Users/runner/miniforge3/conda-bld/multidict_1672339514000/work
munch @ file:///home/conda/feedstock_root/build_artifacts/munch_1684150905574/work
mypy==1.3.0
mypy-extensions==1.0.0
nbclassic @ file:///home/conda/feedstock_root/build_artifacts/nbclassic_1683202081046/work
nbclient @ file:///home/conda/feedstock_root/build_artifacts/nbclient_1684790896106/work
nbconvert @ file:///home/conda/feedstock_root/build_artifacts/nbconvert-meta_1683636231832/work
nbformat @ file:///home/conda/feedstock_root/build_artifacts/nbformat_1685541374434/work
nest-asyncio @ file:///home/conda/feedstock_root/build_artifacts/nest-asyncio_1664684991461/work
networkx @ file:///home/conda/feedstock_root/build_artifacts/networkx_1680692919326/work
nodeenv==1.8.0
notebook @ file:///home/conda/feedstock_root/build_artifacts/notebook_1680870634737/work
notebook_shim @ file:///home/conda/feedstock_root/build_artifacts/notebook-shim_1682360583588/work
numcodecs @ file:///Users/runner/miniforge3/conda-bld/numcodecs_1654108155270/work
numpy @ file:///Users/runner/miniforge3/conda-bld/numpy_1682210346059/work
oauthlib @ file:///home/conda/feedstock_root/build_artifacts/oauthlib_1666056362788/work
overrides @ file:///home/conda/feedstock_root/build_artifacts/overrides_1666057828264/work
packaging @ file:///home/conda/feedstock_root/build_artifacts/packaging_1637239678211/work
pandas==1.3.5
pandas-gbq==0.17.9
pandocfilters @ file:///home/conda/feedstock_root/build_artifacts/pandocfilters_1631603243851/work
parso @ file:///home/conda/feedstock_root/build_artifacts/parso_1638334955874/work
pathspec==0.11.1
patsy @ file:///home/conda/feedstock_root/build_artifacts/patsy_1665356157073/work
pexpect @ file:///home/conda/feedstock_root/build_artifacts/pexpect_1667297516076/work
pickleshare @ file:///home/conda/feedstock_root/build_artifacts/pickleshare_1602536217715/work
Pillow @ file:///Users/runner/miniforge3/conda-bld/pillow_1666920704573/work
pipdeptree==2.9.0
pkgutil_resolve_name @ file:///home/conda/feedstock_root/build_artifacts/pkgutil-resolve-name_1633981968097/work
platformdirs @ file:///home/conda/feedstock_root/build_artifacts/platformdirs_1686403120743/work
plotly @ file:///home/conda/feedstock_root/build_artifacts/plotly_1654895488764/work
pluggy==1.0.0
pooch @ file:///home/conda/feedstock_root/build_artifacts/pooch_1679580333621/work
pre-commit==3.3.2
prometheus-client @ file:///home/conda/feedstock_root/build_artifacts/prometheus_client_1684970902412/work
prompt-toolkit @ file:///home/conda/feedstock_root/build_artifacts/prompt-toolkit_1677600924538/work
proplot @ file:///home/conda/feedstock_root/build_artifacts/proplot_1677584975715/work
proto-plus @ file:///home/conda/feedstock_root/build_artifacts/proto-plus_1673334163294/work
protobuf==4.21.12
psutil @ file:///Users/runner/miniforge3/conda-bld/psutil_1681775207008/work
ptyprocess @ file:///home/conda/feedstock_root/build_artifacts/ptyprocess_1609419310487/work/dist/ptyprocess-0.7.0-py2.py3-none-any.whl
pure-eval @ file:///home/conda/feedstock_root/build_artifacts/pure_eval_1642875951954/work
py-eodms-rapi==1.5.5
pyarrow==9.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.7
pycodestyle==2.10.0
pycparser @ file:///home/conda/feedstock_root/build_artifacts/pycparser_1636257122734/work
pydata-google-auth==1.4.0
pyflakes==3.0.1
Pygments @ file:///home/conda/feedstock_root/build_artifacts/pygments_1681904169130/work
PyJWT @ file:///home/conda/feedstock_root/build_artifacts/pyjwt_1683676063469/work
PyNaCl==1.5.0
pyobjc-core @ file:///Users/runner/miniforge3/conda-bld/pyobjc-core_1686129289943/work
pyobjc-framework-Cocoa @ file:///Users/runner/miniforge3/conda-bld/pyobjc-framework-cocoa_1686136016408/work
pyOpenSSL @ file:///home/conda/feedstock_root/build_artifacts/pyopenssl_1685514481738/work
pyparsing @ file:///home/conda/feedstock_root/build_artifacts/pyparsing_1652235407899/work
pyperclip==1.8.2
pyproj @ file:///Users/runner/miniforge3/conda-bld/pyproj_1670929490271/work
pyrsistent @ file:///Users/runner/miniforge3/conda-bld/pyrsistent_1672681537313/work
pyseas @ git+https://github.com/GlobalFishingWatch/pyseas.git@86d48ff7cc38f7e9a189e9d830ff2c6a05454ba5
pyshape==0.1.1
pyshp @ file:///home/conda/feedstock_root/build_artifacts/pyshp_1659002966020/work
PySocks @ file:///home/conda/feedstock_root/build_artifacts/pysocks_1661604839144/work
pytest==7.3.2
pytest-cov==4.1.0
python-dateutil @ file:///home/conda/feedstock_root/build_artifacts/python-dateutil_1626286286081/work
python-json-logger @ file:///home/conda/feedstock_root/build_artifacts/python-json-logger_1677079630776/work
pytz @ file:///home/conda/feedstock_root/build_artifacts/pytz_1680088766131/work
pyu2f @ file:///home/conda/feedstock_root/build_artifacts/pyu2f_1604248910016/work
PyWavelets==1.4.1
pyxdg==0.28
PyYAML @ file:///Users/runner/miniforge3/conda-bld/pyyaml_1666772543719/work
pyzmq @ file:///Users/runner/miniforge3/conda-bld/pyzmq_1685519412652/work
qtconsole==5.4.3
QtPy==2.3.1
rasterio @ file:///Users/runner/miniforge3/conda-bld/rasterio_1668655036926/work
ray==2.6.3
regex==2023.6.3
Represent==1.6.0.post0
requests @ file:///home/conda/feedstock_root/build_artifacts/requests_1684774241324/work
requests-oauthlib @ file:///home/conda/feedstock_root/build_artifacts/requests-oauthlib_1643557462909/work
retrying==1.3.4
rfc3339-validator @ file:///home/conda/feedstock_root/build_artifacts/rfc3339-validator_1638811747357/work
rfc3986-validator @ file:///home/conda/feedstock_root/build_artifacts/rfc3986-validator_1598024191506/work
rsa @ file:///home/conda/feedstock_root/build_artifacts/rsa_1658328885051/work
Rtree @ file:///Users/runner/miniforge3/conda-bld/rtree_1666813320619/work
ruamel.yaml==0.17.31
ruamel.yaml.clib==0.2.7
rush==2021.4.0
safety==2.3.5
scikit-image==0.21.0
scikit-learn @ file:///Users/runner/miniforge3/conda-bld/scikit-learn_1685023781664/work
scipy==1.9.1
seaborn @ file:///home/conda/feedstock_root/build_artifacts/seaborn-split_1629095986539/work
Send2Trash @ file:///Users/runner/miniforge3/conda-bld/send2trash_1682601407921/work
sentinelsat==1.1.1
service-identity==21.1.0
Shapely @ file:///Users/runner/miniforge3/conda-bld/shapely_1668518218855/work
six @ file:///home/conda/feedstock_root/build_artifacts/six_1620240208055/work
sniffio @ file:///home/conda/feedstock_root/build_artifacts/sniffio_1662051266223/work
snuggs @ file:///Users/ktietz/demo/mc3/conda-bld/snuggs_1629803886966/work
sortedcollections==2.1.0
sortedcontainers==2.4.0
soupsieve @ file:///home/conda/feedstock_root/build_artifacts/soupsieve_1658207591808/work
spacetrack==0.16.0
spake2==0.8
stack-data @ file:///home/conda/feedstock_root/build_artifacts/stack_data_1669632077133/work
statsmodels @ file:///Users/runner/miniforge3/conda-bld/statsmodels_1683305739900/work
sympy==1.12
tabulate==0.9.0
tenacity @ file:///home/conda/feedstock_root/build_artifacts/tenacity_1677600641219/work
terminado @ file:///Users/runner/miniforge3/conda-bld/terminado_1670254106711/work
threadpoolctl @ file:///home/conda/feedstock_root/build_artifacts/threadpoolctl_1643647933166/work
tifffile==2023.4.12
tinycss2 @ file:///home/conda/feedstock_root/build_artifacts/tinycss2_1666100256010/work
toml @ file:///home/conda/feedstock_root/build_artifacts/toml_1604308577558/work
tomli==2.0.1
tomlkit @ file:///home/conda/feedstock_root/build_artifacts/tomlkit_1683028165096/work
tornado @ file:///Users/runner/miniforge3/conda-bld/tornado_1684150425472/work
tqdm @ file:///home/conda/feedstock_root/build_artifacts/tqdm_1677948868469/work
traitlets @ file:///home/conda/feedstock_root/build_artifacts/traitlets_1675110562325/work
Twisted==22.10.0
txaio==23.1.1
txtorcon==23.5.0
types-requests==2.28.11.17
types-urllib3==1.26.25.13
typing-inspect @ file:///home/conda/feedstock_root/build_artifacts/typing_inspect_1685820062773/work
typing-utils @ file:///home/conda/feedstock_root/build_artifacts/typing_utils_1622899189314/work
typing_extensions==4.6.3
tzdata @ file:///home/conda/feedstock_root/build_artifacts/python-tzdata_1680081134351/work
tzlocal==5.0.1
uri-template==1.2.0
uritemplate @ file:///home/conda/feedstock_root/build_artifacts/uritemplate_1634152692041/work
urllib3==1.26.16
urlpath==1.2.0
viola==0.3.8
virtualenv==20.23.0
wcwidth @ file:///home/conda/feedstock_root/build_artifacts/wcwidth_1673864653149/work
webcolors==1.13
webencodings==0.5.1
websocket-client @ file:///home/conda/feedstock_root/build_artifacts/websocket-client_1686311450661/work
Werkzeug==2.3.6
widgetsnbextension @ file:///home/conda/feedstock_root/build_artifacts/widgetsnbextension_1680041491747/work
xmltodict @ file:///home/conda/feedstock_root/build_artifacts/xmltodict_1652020822199/work
xyzservices @ file:///home/conda/feedstock_root/build_artifacts/xyzservices_1684571362432/work
yarl @ file:///Users/runner/miniforge3/conda-bld/yarl_1685191847849/work
yq @ file:///home/conda/feedstock_root/build_artifacts/yq_1682205044037/work
zarr @ file:///home/conda/feedstock_root/build_artifacts/zarr_1649285734910/work
zipp @ file:///home/conda/feedstock_root/build_artifacts/zipp_1677313463193/work
zope.interface==6.0

Additional context

I originally thought this had to do with sentinel-1b failing in December of 2021, but that failure was on the 23rd.

SpicyGarlicAlbacoreRoll commented 8 months ago

Thanks for submitting an issue!

Strangely I can't seem to recreate this issue with the provided tests. I've gotten occasional timeouts that cause the searches to fail but otherwise can't get a 400 error response, Do you happen to have the 4xx error messages on hand?

probinso commented 8 months ago
=== short test summary info ===
FAILED tests/test_asf.py::test_sentinel_1_all - asf_search.exceptions.ASFSearch4xxError: HTTP 404: ['Concept with concept-id [G2179312981-ASF] and revision-id [1] does not exist.']
FAILED tests/test_asf.py::test_sentinel_1_split_2 - asf_search.exceptions.ASFSearch4xxError: HTTP 404: ['Concept with concept-id [G2179312981-ASF] and revision-id [1] does not exist.']
2 failed, 27 passed, 33 warnings in 133.65s (0:02:13)
probinso commented 6 months ago

This is updated with the timezone normalization

from datetime import datetime, timedelta, timezone
import asf_search as asf

XXX = datetime(2021, 12, 7, 10, 55, tzinfo=timezone.utc)
opts = dict(platform=asf.constants.SENTINEL1, start=XXX, end=XXX + timedelta(minutes=1))
results = asf.search(**opts)
probinso commented 6 months ago

When I update to the latest version of asf_search I recieve a bit more detail in the error

ERROR:root:HTTP 404: ['Concept with concept-id [G2179312981-ASF] and revision-id [1] does not exist.']
ERROR:root:The asf-search module ecountered an error with CMR, and the following message was automatically reported to ASF:

"
Error Message: HTTP 404: ['Concept with concept-id [G2179312981-ASF] and revision-id [1] does not exist.']
User Agent: Python/3.10.11; requests/2.31.0; asf_search/7.0.6     
Search Options: {
    start: 2021-12-07T10:55:00Z
    end: 2021-12-07T10:56:00Z
    collections: ['C1205264459-ASF', 'C1205428742-ASF', 'C1208115009-ASF', 'C1208117434-ASF', 'C1212158318-ASF', 'C1212158326-ASF', 'C1212158327-ASF', 'C1212200781-ASF', 'C1212201032-ASF', 'C1212209035-ASF', 'C1212209075-ASF', 'C1212209226-ASF', 'C1212212493-ASF', 'C1212212560-ASF', 'C1212233976-ASF', 'C1214470488-ASF', 'C1214470496-ASF', 'C1214470532-ASF', 'C1214470533-ASF', 'C1214470561-ASF', 'C1214470576-ASF', 'C1214470682-ASF', 'C1214470732-ASF', 'C1214471197-ASF', 'C1214471521-ASF', 'C1214471960-ASF', 'C1214472336-ASF', 'C1214472977-ASF', 'C1214472978-ASF', 'C1214472994-ASF', 'C1214473165-ASF', 'C1214473170-ASF', 'C1215704763-ASF', 'C1216244348-ASF', 'C1216244585-ASF', 'C1216244586-ASF', 'C1216244587-ASF', 'C1216244588-ASF', 'C1216244589-ASF', 'C1216244590-ASF', 'C1216244591-ASF', 'C1216244592-ASF', 'C1216244593-ASF', 'C1216244594-ASF', 'C1216244595-ASF', 'C1216244596-ASF', 'C1216244597-ASF', 'C1216244598-ASF', 'C1216244599-ASF', 'C1216244600-ASF', 'C1216244601-ASF', 'C1225776654-ASF', 'C1225776655-ASF', 'C1225776657-ASF', 'C1225776658-ASF', 'C1225776659-ASF', 'C1234413228-ASFDEV', 'C1234413229-ASFDEV', 'C1234413230-ASFDEV', 'C1234413231-ASFDEV', 'C1234413232-ASFDEV', 'C1234413233-ASFDEV', 'C1234413234-ASFDEV', 'C1234413235-ASFDEV', 'C1234413236-ASFDEV', 'C1234413237-ASFDEV', 'C1234413238-ASFDEV', 'C1234413239-ASFDEV', 'C1234413240-ASFDEV', 'C1234413241-ASFDEV', 'C1234413242-ASFDEV', 'C1234413243-ASFDEV', 'C1234413244-ASFDEV', 'C1234413245-ASFDEV', 'C1234413246-ASFDEV', 'C1234413247-ASFDEV', 'C1234413248-ASFDEV', 'C1234413249-ASFDEV', 'C1234413250-ASFDEV', 'C1234413251-ASFDEV', 'C1234413252-ASFDEV', 'C1234413253-ASFDEV', 'C1234413254-ASFDEV', 'C1234413255-ASFDEV', 'C1234413256-ASFDEV', 'C1234413257-ASFDEV', 'C1234413258-ASFDEV', 'C1234413259-ASFDEV', 'C1234413260-ASFDEV', 'C1234413261-ASFDEV', 'C1234413262-ASFDEV', 'C1234413263-ASFDEV', 'C1240784657-ASFDEV', 'C1244552887-ASFDEV', 'C1244598379-ASFDEV', 'C1245953394-ASF', 'C1257024016-ASF', 'C1257175154-ASFDEV', 'C1257995185-ASF', 'C1257995186-ASF', 'C1258354200-ASF', 'C1258354201-ASF', 'C1259974840-ASF', 'C1259976861-ASF', 'C1259981910-ASF', 'C1259982010-ASF', 'C1260721853-ASF', 'C1260721945-ASF', 'C1260726384-ASF', 'C1266376001-ASF', 'C1327985571-ASF', 'C1327985578-ASF', 'C1327985579-ASF', 'C1327985617-ASF', 'C1327985619-ASF', 'C1327985644-ASF', 'C1327985645-ASF', 'C1327985646-ASF', 'C1327985647-ASF', 'C1327985650-ASF', 'C1327985651-ASF', 'C1327985660-ASF', 'C1327985661-ASF', 'C1327985674-ASF', 'C1327985697-ASF', 'C1327985739-ASF', 'C1327985740-ASF', 'C1327985741-ASF', 'C1595422627-ASF', 'C1595765183-ASF', 'C1596065639-ASF', 'C1596065640-ASF', 'C1596065641-ASF', 'C2450786986-ASF', 'C2709161906-ASF', 'C2777436413-ASF', 'C2777443834-ASF', 'C2795135174-ASF', 'C2795135668-ASF', 'C2803501097-ASF', 'C2803501758-ASF']
}
"If you have any questions email uso@asf.alaska.edu
SpicyGarlicAlbacoreRoll commented 6 months ago

Sorry for the late reply, and thank you for posting the error message! We've determined the issue and are passing it along to the appropriate team.

We'll leave this issue open until the problem granule is confirmed fixed!

SpicyGarlicAlbacoreRoll commented 6 months ago

It seems like this issue has been fixed, would you mind confirming?

probinso commented 6 months ago

Looks like it was fixed.