search

octoai / octoAI

The analytics hypervisor, an operating system to manage all your analytics needs and licensed under Apache 2.0 License.
Apache License 2.0
260 stars 32 forks source link

Using SnappyData as the database store #2

Open fire opened 8 years ago

fire commented 8 years ago

Snappydata is:

  1. spark which allows us to use machine learning algorithms from spark
  2. a sql database which allows us to use standard sql
  3. apache licensed which is the same license as octo.ai
  4. approximate queries allow us to run sampling on the source data
dipankar commented 8 years ago

Hey @fire Thanks for putting up the issue!

dipankar commented 8 years ago

We can finally consider taking this up! Adding more dev firepower.

We just wrapped up Mongo, HBase support as that was in demand.

fire commented 8 years ago

Great! Can't wait to view your progress.

fire commented 8 years ago

If this helps I found:

dipankar commented 8 years ago

Thanks, that is the direction we are taking on this!

fire commented 8 years ago

How has it been going? I also had trouble finding a ruby library for interfacing with Spark and SnappyData.

dipankar commented 8 years ago

Yes, however we are looking at alternate mechanisms to integrate.

Maybe build more specific data models just for snappy.

Though that will make quite a bit of the other code unusable (dashboard, etc.)