Pull-to-refresh conflicts with fast scroll bar

⚠️ Before posting ⚠️

[X] This is a bug, not a question or an enhancement.
[X] I've searched for similar issues and didn't find a duplicate.
[X] I've written a clear and descriptive title for this issue, not just "Bug" or "Crash".
[X] I agree to follow Nextcloud's Code of Conduct.

Steps to reproduce

Open a folder with many files
Scroll down a bit by swiping up the list like normal
Grab the fast scroll bar handle on the right
Try to fast scroll both up and down.

Expected behaviour

Fast scrolling works both up and down.

Actual behaviour

Fast scrolling works only UP.

Fast scrolling DOWN does NOT work. When trying to fast scroll down, pull-to-refresh takes over. (Sometimes I get into a state where it does work. But in the majority of cases pull-to-refresh takes over.)

Android version

13 (Lineage 20)

Device brand and model

OnePlus 5

Stock or custom OS?

Custom (explain in "additional information")

Nextcloud android app version

3.24.1 (F-Droid)

Nextcloud server version

25.0.6

Using a reverse proxy?

Yes

Android logs

Can provide if needed.

Server error logs

No response

Additional information