gbif / registry-console

Apache License 2.0
5 stars 2 forks source link

performance on ingestion page #272

Open MortenHofft opened 5 years ago

MortenHofft commented 5 years ago

https://registry.gbif.org/monitoring/ingestion is far slower than https://management-tools.gbif.org/crawling-monitor

@luckyluck could you please look into your implementation to see what could be the cause of this?

MortenHofft commented 5 years ago

I'm guessing it is because all data is collected before showing anything.

MortenHofft commented 5 years ago

same goes for https://registry.gbif-dev.org/monitoring/pipeline-ingestion. It is insanely slow as the browser need to look up 1000 dataset titles. I attach all titles because I was told we wanted search on names, but performance suffers. Previously we had titles in the result. But it was then removed again. Could we consider bringing them back. Else I believe we would have to remove titles from the interface and just show UUIDs