bcgov / entity

ServiceBC Registry Team working on Legal Entities
Apache License 2.0
23 stars 58 forks source link

Implement - NAMEX API - Investigate all the update services for SOLR #19615

Open ozamani9gh opened 7 months ago

ozamani9gh commented 7 months ago

Kial will do the work to migrate SOLR to GCP, but we will do some investigation work first.

Every service that calls solr, we need to figure out if they go through solr-feeder or not

eve-git commented 7 months ago

solrQueries is invoked in https://github.com/bcgov/namex/blob/main/api/namex/resources/requests.py https://github.com/bcgov/namex/blob/main/api/namex/resources/document_analysis.py https://github.com/bcgov/namex/blob/main/api/namex/analytics/solr.py

Solr Feeder methods use service calls instead of direct queries: https://github.com/bcgov/namex/blob/main/services/solr-names-updater/src/solr_names_updater/names_processors/__init__.py https://github.com/bcgov/namex/blob/main/solr-feeder/solr_feeder/services/search.py

There are models and queries in solr-admin-app. I am not sure if they are applicable in this ticket: https://github.com/bcgov/namex/blob/main/solr-admin-app/solr_admin

They are queries direct to solr here: https://github.com/bcgov/namex/blob/main/solr-synonyms-api/synonyms/services/synonyms/synonym.py

also, there are in unit test cases as well

ozamani9gh commented 5 months ago

ok lets groom this and work with Kial and SRE to migrate this over to GCP

ozamani9gh commented 5 months ago

synonyms will also be updated at the exact time

ozamani9gh commented 3 months ago

@kialj876 let us know if you are able to pick up this work sometime in PI 22.

kialj876 commented 2 months ago

Sorry Omid, I did not see this. Feel free to message me directly on teams in the future. I am not planning to do the solr upgrade until some of the other search solr pieces are moved into gcp / consolidated so that this can utilize it as well. I would also like to wait until namex is moved into GCP as several things will be dependent on that (namex db / namex synonyms db in particular). I am thinking it will be next PI