Paging result sets

[simon-brooke]

This database is going to be large. We will have of the order of one million addresses, four million electors, potentially four million visits. Selecting all data from the database for user interface lists isn't going to work - it will be too slow and things will break.

I haven't seen a good account of how to do paging in any of the high level frameworks such as Korma or HugSql (which is startling).

• There's an example low-level solution here but it's only claimed to work for Oracle and HSQLDB;
• There's another here which is claimed to work with Postgres;

We need something which plays nice with (ideally) HugSql and definitely plays nice with Postgres. We probably ought to do it as a separate library, or possibly as a HugSql pull request, because actually lots of projects are going to need this.

[simon-brooke]

This should be solved by the queries I'm now generating in squirrel-parse, which use the limit-offset solution. It isn't perfect but doesn't have huge overheads and will probably do for now.