search

navis-org / pymaid

Python library to interface with CATMAID servers. Fully interoperable with navis.
https://pymaid.readthedocs.io/en/latest/
GNU General Public License v3.0
24 stars 11 forks source link

Paginate get_entity_graph response as it's very slow #231

Open clbarnes opened 1 year ago

clbarnes commented 1 year ago

The request takes a parameter range_start and another range_length. The response object contains a totalRecords integer.

We should make 1 request of a small number of entities (1000 or so), read the number of total records, and then parallelise getting all the rest.

clbarnes commented 1 year ago

I had a go at this but it seemed to drop some rows between pages.