man-group / arctic

High performance datastore for time series and tick data
https://arctic.readthedocs.io/en/latest/
GNU Lesser General Public License v2.1
3.05k stars 583 forks source link

Speed up chunkstore reads with index #902

Closed TomTaylorLondon closed 3 years ago

TomTaylorLondon commented 3 years ago

Correcting the index to correctly be used in read(..)

https://www.mongodb.com/blog/post/performance-best-practices-indexing

See ESR rule

TomTaylorLondon commented 3 years ago

Note: this fix is in active use, and speeds up queries with a large number of chunks dramatically (10minutes to <1 second)

shashank88 commented 3 years ago

lgtm! 🚢

TomTaylorLondon commented 3 years ago

Thanks!