search

FAIRiCUBE / FAIRiCUBE-Hub-issue-tracker

FAIRiCUBE HUB issue tracker
Creative Commons Zero v1.0 Universal
0 stars 1 forks source link

FAIRiCUBE Catalog Search Options #10

Open KathiSchleidt opened 1 year ago

KathiSchleidt commented 1 year ago

At present, the FAIRiCUBE Catalog only provides one search field. This has various drawbacks:

While I appreciate the usefulness of such a simplified search for some use cases, I believe we'll also need an expert search, clearly exposing the individual metadata fields, ideally providing the user with available content for each field (e.g., a list of the types of license provided under the license field)

This requirement is for both dataset and processing resource metadata

Schpidi commented 1 year ago

Agreed, the current catalog is fairly limited as it is a static catalog and the search is a pure client side one. Our idea is to harvest the static catalog into a tool providing API support e.g. PyCSW or STAC-FastAPI that can be used in clients.

KathiSchleidt commented 1 year ago

@Schpidi while an API would be most welcome for FAIRiCUBE metadata, thinking back to our core objective of making all this data cube magic more graspable for mere mortal humans, I do believe something like a GUI would also be required

Schpidi commented 1 year ago

sure, once we have the API following the STAP API spec we can use any STAC client in front of it

KathiSchleidt commented 1 year ago

@Schpidi have you identified a STAC Client we'll use within FAIRiCUBE Hub?

Schpidi commented 1 year ago

we made good experience with STAC Browser (https://github.com/radiantearth/stac-browser) and will explore usage for FAIRiCUBE. The current static FAIRiCUBE catalog can be explored in STAC Browser at https://radiantearth.github.io/stac-browser/#/external//catalog.fairicube.eu/stac/?.language=en

KathiSchleidt commented 1 year ago

@Schpidi on the radiantearth STAC Browser, can this also do search on specific fields, or just the search for title? Especially on the spatiotemporal aspects, we'd need to be able to provide intervals. I'd really like to see an example with more than one generic search field (actually, I'd really like to see this deployed for FAIRiCUBE! M7: FAIRiCUBE HUB in operation is due 30.06.2023)

In addition, I'm now totally confused as to the datasets described by the FAIRiCUBE catalog:

As both catalog versions you point me to have more datasets than requested, I'm pretty sure that the current content have more to do with what EOX has available on EuroDataCube, less with what the UC have requested

jetschny commented 1 year ago

As for now, the important question for me is: will the current https://catalog.fairicube.eu/ stay or will it go!

this depends on what requirements this catalogue has (can only read yaml files is a no-go) and how much we can configure it to provide us with a GUI that we need (with more then one search field). @Schpidi : when will this decision been made? I read that radiant STAC Browser is an alternative (?) under consideration?

Schpidi commented 1 year ago

@jetschny our current plan is to deploy STAC Browser connected to STAC API which holds the static STAC JSONs harvested from https://fairicube.github.io/resource-metadata/ and https://fairicube.github.io/data-requests/. STAC API allows us to do more advanced searches in the client (see https://github.com/FAIRiCUBE/FAIRiCUBE-Hub-issue-tracker/issues/5#issuecomment-1580835504). Which URL we use for this deployment can still be discussed, we can either replace the existing one or add another one in addition.

Cc @eox-cs1

eox-cs1 commented 1 year ago

see also: https://github.com/FAIRiCUBE/FAIRiCUBE-Hub-issue-tracker/issues/5

KathiSchleidt commented 1 year ago

Thanks for the example

Question on the configuration options of the radiantearth browser - can one explicitly expose individual concepts, or can they only be offered under "additional filters"?

eox-cs1 commented 8 months ago

FAIRiCUBE stac-fastapi Catalog, is now available with the long awaited extended Search functionality. At the moment still limited to the Title. (Add filter -> Title -> (=)button -> matches (case-insensitive) /matches (case-sensitive) https://catalog.eoxhub.fairicube.eu/

KathiSchleidt commented 8 months ago

@eox-cs1 cool! Just tried, but seem to have failed. First checked the existing datasets, see that there's one with the title "Water Bodies". Did a case insensitive search for "water", got 0 results :?

grafik

eox-cs1 commented 8 months ago

Please also read the instructions given below the search field!