ncbo / ncbo_cron

Jobs that run on a regular basis in the NCBO infrastructure
Other
2 stars 6 forks source link

4store crashes when the mapping counts generation job is executed #39

Open mdorf opened 3 years ago

mdorf commented 3 years ago

When running the mapping counts generation script (either via the scheduled CRON job or via the on-demand script) against production 4store instance, the run never fully completes. 4store crashes at random points during the execution. This behavior is NOT reproducible in the Staging environment. In Staging, the job completes in 5.5 hours.

jvendetti commented 2 years ago

Wanted to add clarification here that the mapping counts generation job has been disabled in our production environment since late April, 2021. It wasn't immediately evident to me how to check this, so I'm documenting the steps here:

  1. SSH into the production parsing box
  2. Change to the ncbo-deployer user
  3. Navigate to /srv/ncbo/ncbo_cron/config

There's a config file in this directory called config.rb that overrides the enable_mapping_counts configuration and disables the job:

begin
  NcboCron.config do |config|
    ...
    # disable mappings count;  it makes 4store unsable in production
    config.enable_mapping_counts      = false
end

The above override takes precedence over this line of source code:

https://github.com/ncbo/ncbo_cron/blob/3d585ec682d84054668f939b613388186020faa0/lib/ncbo_cron/config.rb#L32