mpi2 / PhenotypeData

Reorganisation, update, and extend code from PhenotypeArchive
Apache License 2.0
2 stars 5 forks source link

Solr ETL build references old hosts #622

Open mrelac-ebi opened 3 years ago

mrelac-ebi commented 3 years ago

The solr cores do not build on the new MI_BUILD host because, at least in part, there are references to the old build host, ves-ebi-d9. At a minimum, those references need to be changed to wp-np2-8a (or create/use an alias for MI_BUILD).

From @mrelac-ebi e-mail dated 24/06/2021 09:25 (subject 'DEV core buids'):

Here is the path to the log files for the IMPC_build_daily_solr_DEV run I just did. If you execute these commands as mi_hadoop on ebi-cli, you'll see the references to ves-ebi-d9:

ssh mi_hadoop@ebi-cli
cd impc-etl
grep 'ves-' *

ficolo commented 3 years ago

The references are to the luigi central scheduler that is still running on the old build machine, it has nothing to do with the Solr Cores.

Is luigi installed and running on the new host already?

mrelac-ebi commented 3 years ago

Hi Fede,

I did not install luigi on the new build host. Any ETL extras that are needed must be installed on MI_BUILD (wp-np2-8a).

On 01/07/2021 09:22, Federico López Gómez wrote:

The references are to the luigi central scheduler that is still running on the old build machine, it has nothing to do with the Solr Cores.

Is luigi installed and running on the new host already?

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/mpi2/PhenotypeData/issues/622#issuecomment-872035551, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADCPTCICTWOZQ2DWGJBUFMDTVQQTVANCNFSM47J4BLWA.

-- Mike Relac Software Developer Mouse Informatics Project East Wing, A2-140 European Bioinformatics Institute (EMBL-EBI) European Molecular Biology Laboratory Wellcome Genome Campus Hinxton Cambridge CB10 1SD United Kingdom +44 1223 494 142

viomunoz commented 2 years ago

PDX also using the luigi server, need to coordinate with them.