search

rilldata / rill

Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.
https://www.rilldata.com
Apache License 2.0
1.64k stars 111 forks source link

Add Mongo Connection as option #5101

Open ericschmar opened 3 months ago

ericschmar commented 3 months ago

Is your feature request related to a problem? Please describe. We have data sources spanning csv, parquet, etc. but also have a data source using MongoDB. Currently, I have to export our enormous collection and run my own script to convert it into a parquet file before importing it.

Describe the solution you'd like Ideally, I could add a connection within Rill and query data real time that way.

Describe alternatives you've considered Microsoft Power BI but the licensing cost is too high.

Additional context N/A

mindspank commented 3 months ago

Thanks for the request!

query data real time

Would you envision that we push sql queries down to mongodb via Atlas (can potentially be quite slow) or that we ingest your collection into Rill?

ericschmar commented 14 hours ago

I think the simplest solution would be to import the collection and do the conversion into Rill. That's really the only way to keep quick pivots and joins, as well.