Optimizer window pagination

Kitefiko commented 1 month ago

Describe the Bug

I believe I have found multiple issues with window pagination implementation.

AttributeError is always thrown in ListConnectionWithTotalCount.resolve_connection_from_cache
backup solution in case of AttributeError prevents pagination
order and thus pagination itself is non-deterministic when explicit order is not used
usage of last returns everything and bypasses max_results

System Information

Operating system: linux
Strawberry version (if applicable): 0.47.1
Database version: 10.11.6-MariaDB

Additional Context

`ListConnectionWithTotalCount.resolve_connection_from_cache`

AttributeError is always thrown here: https://github.com/strawberry-graphql/strawberry-django/blob/d6051db6f1e792604d66206734df9d6ebcfbbb40/strawberry_django/relay.py#L195 I think there should be something like this?

has_next_page = result[-1]._strawberry_row_number < result[-1]._strawberry_total_count if result else False

Backup solution in case of `AttributeError` prevents pagination

This might be intended behavior, but: In case of AttributeError pagination falls back to resolve_connection but (probably due to unavailable overfetch?) pageInfo's hasNextPage is wrongly reporting as false

Order and thus pagination itself is non-deterministic when explicit order is not used

This is probably the biggest issue. Maybe fixable via pk ordering in case of empty order_by in apply_window_pagination ?

Usage of `last` returns everything and bypasses `max_results`

When last is used on it's own and execution ends up here: https://github.com/strawberry-graphql/strawberry-django/blob/d6051db6f1e792604d66206734df9d6ebcfbbb40/strawberry_django/optimizer.py#L561-L573

slice_metadata.start is evaluated to 0 slice_metadata.end becomes sys.maxsize

and queryset ends up filtering out nothing

Upvote & Fund

We're using Polar.sh so you can upvote and help fund this issue.
We receive the funding once the issue is completed & confirmed by you.
Thank you in advance for helping prioritize & fund our backlog.

bellini666 commented 3 weeks ago

Hey @Kitefiko ,

Hrm, I'm not really I understood the issue. When and why does AttributeError gets raised for you? Could you try to provide an MRE for it?

SupImDos commented 1 week ago

Hi @bellini666

We've run into these issue as well, particularly with ListConnectionWithTotalCount.resolve_connection_from_cache here:

https://github.com/strawberry-graphql/strawberry-django/blob/d6051db6f1e792604d66206734df9d6ebcfbbb40/strawberry_django/relay.py#L195

Just so its clear, the result object here is actually the QuerySet._result_cache list, so it will never have the annotated _strawberry_row_number / _strawberry_total_count attributes. It's items will though, so as suggested in parent issue it should instead be something like:

has_next_page = (
    result[-1]._strawberry_row_number < result[-1]._strawberry_total_count
    if result
    else False
)

SupImDos commented 1 week ago

@bellini666 FYI #622 only fixes 1 of the 4 problems raised in this issue, so it may be worth keeping this open?

bellini666 commented 1 week ago

@SupImDos good point, going to reopen this

strawberry-graphql / strawberry-django