clearlydefined / crawler

A service that crawls projects and packages for information relevant to ClearlyDefined
MIT License
43 stars 30 forks source link

Failure to harvest dpdk/dpdk-stable #534

Open AlanElder opened 5 months ago

AlanElder commented 5 months ago

I've tried multiple times to harvest version v22.11.3 / commit ID 7849366693a2a2cbc5279a6bfd39cbb457fe7c96 of dpdk/dpdk-stable (https://github.com/dpdk/dpdk-stable/tree/7849366693a2a2cbc5279a6bfd39cbb457fe7c96) but it appears to consistently fail to harvest.

image

https://clearlydefined.io/definitions/git/github/dpdk/dpdk-stable/7849366693a2a2cbc5279a6bfd39cbb457fe7c96

Previous versions of the same repository have harvested successfully, e.g.

https://clearlydefined.io/definitions/git/github/dpdk/dpdk-stable/e185150c2ada84e637d14274ec456a3a4965487e

I don't seem to be able to curate the license information until harvesting has successfully completed, so this prevents any license information being added for this version.

AlanElder commented 5 months ago

The harvesting seems to have worked now - maybe it just takes a long time?