Closed MortenHofft closed 1 year ago
MortenHofft
commented
3 years ago Perhaps the first version should support only what can be modelled using api.gbif.org/v1/dataset/search only
And that can then be extended with a lists that cannot be filtered. Those could be driven from hardcoded list, occurrence facets or perhaps even combinations followed by a unique filter. Perhaps even a basic client side search.
MortenHofft
commented
3 years ago To progress this issue the first version has been limited to scopes that can be supported by the current dataset search endpoint api.gbif.org/v1/dataset/search
network filtering for dataset search is being developed and is in UAT environment https://github.com/gbif/registry/issues/346
That leaves e.g. taxonomic scoped portals. That will have to wait for a version 2, and so far no one has asked for it.
Dataset search isn't ready to add to any sites not really for feedback, but the work in progress can be seen online
MortenHofft
commented
1 year ago This is now in production. Feedback and ideas are always welcome at any time. Components are expected to evolve over time
There seem to be a wide interest in having dataset and publisher search. But I'm not sure how to do it. This is an attempt to describe why it is tricky and hopefully someone can help clarify the needs and perhaps offer solutions.
Below I use datasets as an example - it is similar for publisher search. The sites can be scoped very differently:
Network based The scope is defined by a list of datasets associated with a network. But those datasets are not available in the normal dataset search API. They have their own endpoint (that isn't searchable). So providing search isn't really possible. e.g. dataset/search?q=Diepenbeek works as expected network/2b7c7b4f-4d4f-40d3-94de-c28b6fa054a6/constituents?q=Diepenbeek does NOT work
Other scopes without dataset filter equivalents Most sites are not scoped by by a filter that also applies to datasets. Occurrences in country X for example. Or taxonomic scope.
There is no way to create a filter for that on gbif.org/dataset/search - so what API endpoint to use for a list of datasets?
We could do a facet driven list (similar to the current dataset tab that is reported as confusing). That is a list of distinct datasets in the set of occurrences in scope. But that would then leave out all datasets without occurrences (e.g. many checklists) and it wouldn't support the same filters as the regular dataset search - e.g. no search for dataset types and no free text search in descriptions. And it wouldn't sort on best textual match, but on size.
Scoped by filters that also work for datasets Scoped by publisher, host, publishing Country, project or license.
These are easy as they are the filters supported by the dataset search API. Unfortunately there are few of those portals.
Scoped by single dataset Finally there is the trivial case - scoped by dataset. A dataset search isn't relevant in those cases.
This issue is close related to https://github.com/gbif/hosted-portals/issues/12 https://github.com/gbif/hosted-portals/issues/19