search

ckan / ckanext-archiver

Archive CKAN resources
MIT License
22 stars 46 forks source link

Moving to new background job system introduced in CKAN 2.7 #42

Closed KrzysztofMadejski closed 6 years ago

KrzysztofMadejski commented 7 years ago

CKAN 2.7 has introduced a new background job system. Before version 2.7 (starting from 1.5), CKAN offered a different background job system built around Celery. That system is still available but deprecated and will be removed in future versions of CKAN.

Background task (2.7): http://docs.ckan.org/en/latest/maintaining/background-tasks.html Migration guide: http://docs.ckan.org/en/latest/maintaining/background-tasks.html#background-jobs-migration

That relates to https://github.com/ckan/ckanext-qa/issues/52 (Upgrade Celery to 3.x) as new jobs are based on RQ (Redis). It seems that instead of upgrading Celery it would be wise to move forward and handle new ckan jobs. @davidread, any thoughts on that?

davidread commented 7 years ago

The celery upgrade is just a quick test to see it all still works as before. I imagine the move to RQ is a lot more involved and updating docs etc. I'd be very pleased if you do either.

Zharktas commented 6 years ago

Closed in #55