search

apache / drill

Apache Drill is a distributed MPP query layer for self describing data
https://drill.apache.org/
Apache License 2.0
1.95k stars 979 forks source link

Mongo DB Storage Plugin : performance slow #2906

Open dwevedivaibhav opened 7 months ago

dwevedivaibhav commented 7 months ago

Hi Team,

I'm attempting to retrieve a large collection of data and apply filtering based on datetime, but the performance is quite slow. Despite adding a datetime filter index to the MongoDB collection, it seems that the index is not being utilized by drill.

Please find the sample query which i am executing from apache drill

select * FROM mongo.sampletable WHERE SentTime >= TO_TIMESTAMP('2023-08-10 00:00:00', 'yyyy-MM-dd HH:mm:ss') AND SentTime < TO_TIMESTAMP('2023-08-17 00:00:00', 'yyyy-MM-dd HH:mm:ss') LIMIT 10

any leads will be apricated.

Thanks

jnturton commented 7 months ago

Can you attach the query profile here? In the Drill web UI, Profiles -> (your query) -> JSON profile.