apache / superset

Apache Superset is a Data Visualization and Data Exploration Platform
https://superset.apache.org/
Apache License 2.0
62.79k stars 13.87k forks source link

Does superset support integration with MongoDB? #4231

Closed priyankajuyal closed 5 years ago

priyankajuyal commented 6 years ago

I tried connecting using the following SQLAlchemy URI mongodb://localhost:27017/test

and faced the following error: ERROR: {"error": "Connection failed!\n\nThe error message returned was:\nCan't load plugin: sqlalchemy.dialects:mongodb"}

Is there any workaround? Please suggest.

xrmx commented 6 years ago

Feel free to contribute a mongodb sqlalchemy dialect.

xiaohanyu commented 6 years ago

@priyankajuyal I think there're 3 methods to support mongodb in superset:

rumbin commented 6 years ago

4th option:

Use an SQL wrapper like https://dremio.com.

(I am not related to this project or company, but happened to stumble upon it, recently)

alanderex commented 6 years ago

5th option:

There is a tool called BI Connector from mongodb, this tool can map mongodb schemata to relational. It's used to interact e.g. with Tableau or other BI Tools. Unfortunately AFAIK it's only available in a paid mongodb version. https://www.mongodb.com/products/bi-connector

tomasienrbc commented 6 years ago

@rumbin I don't think there's a Dremio connector for Superset though, have you seen one?

ksangeet9ap commented 6 years ago

I have created a MongoDB connector for Superset under the name of cosmos. It is still WIP. Feel free to check it out. Star it and post issues so that it can be developed further. https://github.com/ksangeet9ap/incubator-superset

mistercrunch commented 6 years ago

For Dremio, your best bet is probably https://github.com/sqggles/sqlalchemy_dremio

ksangeet9ap commented 6 years ago

@mistercrunch Any plans on integrating NoSQL databases to Superset?

mistercrunch commented 6 years ago

The real question is "Any plans for NoSQL databases to start supporting SQL?". ElasticSearch just added experimental SQL support, Druid added SQL a few years back. Apache Calcite makes that a lot easier now.

Even though it's totally doable with Superset (check out the superset/connectors folder, and druid/ as an example of NoSQL support), I haven't heard anyone working on it besides the ElasticSearch effort on an open PR. Now that ElasticSearch offers SQL support we'll probably go the SQLAlchemy route.

stale[bot] commented 5 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

vamshi9666 commented 5 years ago

so , how may anyone use superset with MongoDB . Please, tell me any possible way of doing it

yuxiaorui commented 4 years ago

1、Mongodb-BI-Connector with sqlalchemy-mongobi http://docs.mongodb.com/bi-connector/master/ https://pypi.org/project/sqlalchemy-mongobi/ 2、Presto MongoDB Connector https://prestodb.io/docs/current/connector/mongodb.html

bnorbert commented 4 years ago

1、Mongodb-BI-Connector with sqlalchemy-mongobi 2、Presto MongoDB Connector @yuxiaorui can you provide an example or more details?

sanderdekoning commented 4 years ago

1、Mongodb-BI-Connector with sqlalchemy-mongobi 2、Presto MongoDB Connector

Could you explain how I would implement this?

thunderbird57 commented 4 years ago

5th option:

There is a tool called BI Connector from mongodb, this tool can map mongodb schemata to relational. It's used to interact e.g. with Tableau or other BI Tools. Unfortunately AFAIK it's only available in a paid mongodb version. https://www.mongodb.com/products/bi-connector

Its available for free now. I would like to know if someone was able to connect through it

shrivastava-utkarsh commented 4 years ago

1、Mongodb-BI-Connector with sqlalchemy-mongobi http://docs.mongodb.com/bi-connector/master/ https://pypi.org/project/sqlalchemy-mongobi/ 2、Presto MongoDB Connector https://prestodb.io/docs/current/connector/mongodb.html

I tried using the 1st option. It gives me driver not found error. I installed it in the same venv also. but still no luck. Did anyone got it working this way? ERROR: Could not load database driver: mongobi the exact error when testing connection using sql alchemy uri

MarcusSorealheis commented 4 years ago

Is there anybody using Superset and MongoDB?

jbouzekri commented 3 years ago

I just made a proof of concept of querying a mongo database with superset through mongo bi connector : https://github.com/jbouzekri/docker-superset-mongo-poc/. It seems to work pretty well. It is not in the documentation but I have tested row level security and it works too.

kodeine commented 2 years ago

@jbouzekri thank you for the POC! really appreciate your efforts.

Hugh-Guan commented 2 years ago

@jbouzekri thank you for the POC! But I ran into some problems using it: pulling the code locally and then executing the 'docker-compose up' directive encountered an error and terminated the directive. Could you give me some help?

jbouzekri commented 2 years ago

@Hugh-Guan : can you open an issue directly in the POC repository with the details of the error ? Thanks in advance

Hugh-Guan commented 2 years ago

@Hugh-Guan : can you open an issue directly in the POC repository with the details of the error ? Thanks in advance

@jbouzekri Thank you for your reply. I have put forward an issue in the project

pesua commented 2 years ago

Have anyone tried integrating Superset with Azure Cosmos DB? It has a MongoDB API, I wonder if it works with sqlalchemy.