Integrate Intake with Omnisci

Quansight / omnisci

Explorations on using MapD and Jupyter together.

4 stars 1 forks source link

Closed dharhas closed 4 years ago

dharhas commented 5 years ago

The goal is to enable use of OmniSci as an end to end workflow engine/pipeline.

[ ] Use Intake to build a data catalog of OmniSci databases
[ ] Intake to provide larger data sources that are outside omnisci (i.e on S3, Landsat etc.
[ ] Intake plugin for OmniSci internal data format and data catalogs
[ ] Develop federated catalogs based on intake/yaml data sources
[x] Add ibis container for intake sources. (See https://github.com/intake/intake/issues/347)

ian-r-rose commented 5 years ago

Work on item 3 begun in Quansight/intake-omnisci#2

ian-r-rose commented 5 years ago

Work on item 5 also begun in Quansight/intake-omnisci#2

ian-r-rose commented 5 years ago

Also related, upstream API changes in intake/intake-sql#6

mpeaton commented 5 years ago

Which Omnisci databases are referred to in Item 1? Similarly, are there specific S3, Landsat databases for test?

dharhas commented 4 years ago

ibis intake created, new work will be in a new issue.