There is a scaling problem with the paginator where the response time increase with the count of pages that have been paginated.
The problem can be solved by changing the $eq operator to $lte, then hinting at the correct index. We see no indication of any degradation changing this it seems to always perform equal or better.
We have run multiple tests against the staging database and with this change for example one of the biggest users in perf4:
There is a scaling problem with the paginator where the response time increase with the count of pages that have been paginated.
The problem can be solved by changing the $eq operator to $lte, then hinting at the correct index. We see no indication of any degradation changing this it seems to always perform equal or better.
We have run multiple tests against the staging database and with this change for example one of the biggest users in perf4:
Pre fix
After fix
Mongo cpu before and after change:
