The gather_stage function in the CKAN RDF harvester appears to have a limitation in handling incorrect pagination entities within hydra:PagedCollection. Specifically, when hydra:nextPage resources reference pages that have already been visited, the harvesting process may enter into an infinite loop, causing it to continue until the system's RAM capacity is reached and the job is terminated.
The
gather_stagefunction in the CKAN RDF harvester appears to have a limitation in handling incorrect pagination entities withinhydra:PagedCollection. Specifically, whenhydra:nextPageresources reference pages that have already been visited, the harvesting process may enter into an infinite loop, causing it to continue until the system's RAM capacity is reached and the job is terminated.