datagovuk / dgu-vagrant-puppet

[unmaintained] Container environment for booting fresh DGU virtual machines. Create VMs with Vagrant, configure them with Puppet.
37 stars 29 forks source link

New dataset are not checked for openess #89

Open tbalaz opened 9 years ago

tbalaz commented 9 years ago

Hi,

when i add new dataset there is no openness rating on that dataset.

As i understand this should be done automaticaly.

I have these jobs running in supervisord:

_command=sudo -u www-data home/co/ckan/bin/paster --plugin=ckanext-harvest harvester gather_consumer --config=/var/ckan/ckan.ini_

_command=sudo -u www-data home/co/ckan/bin/paster --plugin=ckanext-harvest harvester gather_consumer --config=/var/ckan/ckan.ini_

_command=sudo -u www-data /home/co/ckan/bin/paster --plugin=ckan celeryd run concurrency=1 --queue=priority --config=/var/ckan/ckan.ini_

_command=sudo -u www-data home/co/ckan/bin/paster --plugin=ckan celeryd run concurrency=4 --queue=priority --config=/var/ckan/ckan.ini_

and i have these jobs under cron.d

every 10 minutes _/home/co/ckan/bin/paster --plugin=ckanext-harvest harvester run --config=/var/ckan/ckan.ini_

every 30 minutes _/home/co/ckan/bin/paster --plugin=ckanext-archiver archiver update --config=/var/ckan/ckan.ini_

For downloading datasets to local cache i manualy run

_sudo -u www-data home/co/ckan/bin/paster --plugin=ckan celeryd run concurrency=4 --queue=bulk--config=/var/ckan/ckan.ini_

i have also run _drush ckan_resync_all_ after adding new dataset.

Please advice.

davidread commented 9 years ago

The 5 stars should be done by this celery process running:

sudo -u www-data /home/co/ckan/bin/paster --plugin=ckan celeryd run concurrency=1 --queue=priority --config=/var/ckan/ckan.ini

I suggest you run it on the command-line rather than supervisord if it is not working.

Also check you celery logs: /var/log/ckan/celeryd.log

The celery config is in /var/ckan/ckan.ini - maybe you have an old one. You might not have the redis config: https://github.com/datagovuk/dgu-vagrant-puppet/blob/togo/puppet/modules/dgu_ckan/templates/ckan.ini.erb#L21-L29

Also check that redis is setup.