Speed up indexing - Githubissues

xcube-dev / xcube-smos

Experimental xcube support for ESA EE SMOS Level-2 data

https://xcube-dev.github.io/xcube-smos/

MIT License

0 stars 0 forks source link

Speed up indexing #12

Closed forman closed 9 months ago

forman commented 11 months ago

Indexing by nckcidx sync is currently done sequentially file-by-file. Better runtime performance could potentially be achieved by parallel processing using multiple threads or processes.

forman commented 9 months ago

We now use SmosDirectCatalog by default, SmosIndexCatalog may be deprecated in the future. Reopen this issue, if we decide something different later.