search

precog / platform

Advanced Analytics Engine for NoSQL Data
http://www.slamdata.com
GNU Affero General Public License v3.0
401 stars 64 forks source link

Mongo still supported? #521

Closed StephenOTT closed 11 years ago

StephenOTT commented 11 years ago

Hey

Is mongodb still supported as a db or is the expectation to now use the precog builtin db and use the api to get the data in?

thanks

djspiewak commented 11 years ago

Mongo is still supported (in that it still works). I actually don't know how to build a mongo-backed distribution. There are scripts somewhere. @dchenbecker is probably the one with the most knowledge here.

nuttycom commented 11 years ago

Correction, the Mongo backend has not been maintained such that it's functional in the current master, due to the semantic changes required for some of the "filesystem" support. The VFS stuff tries to conflate disparate operations, and was fundamentally a bad idea in my opinion, so you'll need to go back to 2a2673b5859bfee3ef9ccb1f06c7ba6fc01c3472 or so to get it in a functional state.

I'll be adding back in some of the branches and tags that were pruned in the open-sourcing process over the coming days as I get time. The mongo backend is functional on the 2.7.x branch (not yet represented in the repo, but the commit I pointed at is a merge-base for it that should be in not-too-unreasonable shape).

On Thu, Oct 3, 2013 at 11:27 AM, Daniel Spiewak notifications@github.comwrote:

Mongo is still supported (in that it still works). I actually don't know how to build a mongo-backed distribution. There are scripts somewhere. @dchenbecker https://github.com/dchenbecker is probably the one with the most knowledge here.

— Reply to this email directly or view it on GitHubhttps://github.com/precog/platform/issues/521#issuecomment-25640546 .

nuttycom commented 11 years ago

That is, you'll need to go back there to get Mongo in a functional state. The VFS issue is a separate one; there are currently some service interfaces that are promising atomicity for operations that they really shoudn't, and this resulted in some hackery. Those hacks (and the promises that induced them) are on my short-list for removal... at least on my fork. :)

On Thu, Oct 3, 2013 at 12:08 PM, Kris Nuttycombe kris.nuttycombe@gmail.comwrote:

Correction, the Mongo backend has not been maintained such that it's functional in the current master, due to the semantic changes required for some of the "filesystem" support. The VFS stuff tries to conflate disparate operations, and was fundamentally a bad idea in my opinion, so you'll need to go back to 2a2673b5859bfee3ef9ccb1f06c7ba6fc01c3472 or so to get it in a functional state.

I'll be adding back in some of the branches and tags that were pruned in the open-sourcing process over the coming days as I get time. The mongo backend is functional on the 2.7.x branch (not yet represented in the repo, but the commit I pointed at is a merge-base for it that should be in not-too-unreasonable shape).

On Thu, Oct 3, 2013 at 11:27 AM, Daniel Spiewak notifications@github.comwrote:

Mongo is still supported (in that it still works). I actually don't know how to build a mongo-backed distribution. There are scripts somewhere. @dchenbecker https://github.com/dchenbecker is probably the one with the most knowledge here.

— Reply to this email directly or view it on GitHubhttps://github.com/precog/platform/issues/521#issuecomment-25640546 .

jdegoes commented 11 years ago

I think mongo will come back in head but not in the way it existed previously; users should ideally be able to mount a mongodb database inside a folder, and rely on Precog to push operations down to Mongo where appropriate. That's a longer term goal and wouldn't happen until a lot of refactoring has occurred wrt the intermediate algebra, solve constructs, etc.