Retrieving a view is very slow and possibly even times out on fetch

Informatievlaanderen / VSDS-LDESServer4J

Linked Data Event Streams Server for Java

https://informatievlaanderen.github.io/VSDS-LDESServer4J

European Union Public License 1.2

9 stars 8 forks source link

Retrieving a view is very slow and possibly even times out on fetch #1028

Open rorlic opened 8 months ago

rorlic commented 8 months ago

Describe the bug When a LDES contains a large(r) number of members than retrieving the view takes a (very) long time. This is due to the remainingItems being calculated.

To Reproduce Try to fetch view http://brugge.ldes.geomobility.eu/observations/by-page This returns a 504 Gateway Time-out

Expected behavior View is displayed in a timely manner.

jobulcke commented 4 months ago

This may be moved to Jira (if we still wants to add remaing members after it has been disabled for 4-5 months now) and/or needs to be re-evaluated after the Postgres migration, as the count query there should faster than in Mongo