search

ARGA-Genomes / arga-data

ARGA
Mozilla Public License 2.0
0 stars 0 forks source link

Use ElasticSearch in Pipelines (instead of SOLR) #35

Closed nickdos closed 1 year ago

nickdos commented 1 year ago

Dave has advised this is possible and would allow ARGA to use the GBIF GraphQL code (Apollo.js) pretty much as-is.

I’ve got Occurrence only archives indexing into Elastic its not merged into dev yet its in this PR: https://github.com/gbif/pipelines/pull/835 On this branch: https://github.com/gbif/pipelines/tree/60_extended_sensitive_data_pr not following in la-pipelines-local.yaml:

# which filesystem to use: local or hdfs
elastic:
esSchemaPath: /Users/mar759/dev/pipelines/livingatlas/pipelines/src/test/resources/complete-event-pipeline/es-event-core-schema.json
nickdos commented 1 year ago

Got ES index working locally, finally.

image

Nice to see that the full URL for fields is shown in ES (not in SOLR), so provides impetus to create a URL name space for ARGA terms (vs the generated http://unknown.org/ncbi_bioproject schema).

nickdos commented 1 year ago

Moved to https://arga-project.atlassian.net/browse/ARGA-93