search

catalyst / moodle-tool_metadata

Moodle Metadata API
2 stars 0 forks source link

Speed up metadata extraction when processing backlog #2

Closed tomdickman closed 4 years ago

tomdickman commented 4 years ago

Currently the extraction cron task has an arbitrary number of extractions (1000) and this runs once per day.

This will take far too long to update the metadata for all resources in backlog when this plugin is installed, therefore I propose that we need to make the cron task run more often and dynamically add extraction adhoc tasks up to a limit based on how many are still outstanding so that we are always extracting metadata with no downtime.

tomdickman commented 4 years ago

This was resolved by PRs #9 and #20 which introduced admin settings to control queue size