arunoda / meteor-cluster

Smarter way to run cluster of meteor nodes
http://meteorhacks.com/meteor-cluster-introduction-and-how-it-works.html
100 stars 12 forks source link

Potential for using DDP.connect instead of Redis #4

Closed parasj closed 4 years ago

parasj commented 11 years ago

With 0.6.5, DDP is supported for server to server connections. Is it feasible to use this instead of redis for event propagation across the cluster?

Meteor.connect has been renamed to DDP.connect and is now fully supported on the server. Server-to-server DDP connections use websockets, and can be used for both method calls and subscriptions.

From https://github.com/meteor/meteor/blob/devel/History.md

arunoda commented 11 years ago

I'm not quite sure. Since it doesn't scale much. Eg:- you've to connect to each server from each server. Need to reconfigure each server for addition of each server. (Can implement a work around) But a viable candidate.

But it highly recommend oplog based scaling technique. Try smart collections.

On Wednesday, August 21, 2013, Paras Jain wrote:

With 0.6.5, DDP is supported for server to server connections. Is it feasible to use this instead of redis for event propagation across the cluster?

Meteor.connect has been renamed to DDP.connect and is now fully supported on the server. Server-to-server DDP connections use websockets, and can be used for both method calls and subscriptions.

— Reply to this email directly or view it on GitHubhttps://github.com/arunoda/meteor-cluster/issues/4 .

Arunoda Susiripala

@arunoda http://twitter.com/arunoda http://gplus.to/arunodahttps://github.com/arunoda http://www.linkedin.com/in/arunoda

parasj commented 11 years ago

I've been looking at smart collections, it looks good. I'll try to try it at some point

On an unrelated note, have you seen the size of the Redis server affect performance?

So far, I've been using RedisToGo's free plan with 5MB RAM since it seems that Redis is only being used for pub/sub. I assume that since nothing is being stored and is simply relaying sync data, it shouldn't be an issue.

Edit: I just checked meteorhacks.com and I saw updated smart collections. Nice work.

arunoda commented 11 years ago

Yeah. It is only pub/sub and there won't be much overhead.

On Wed, Aug 21, 2013 at 9:27 AM, Paras Jain notifications@github.comwrote:

I've been looking at smart collections, it looks good. I'll try to try it at some point

On an unrelated note, have you seen the size of the Redis server affect performance?

So far, I've been using RedisToGo's free plan with 5MB RAM since it seems that Redis is only being used for pub/sub. I assume that since nothing is being stored and is simply relaying sync data, it shouldn't be an issue.

— Reply to this email directly or view it on GitHubhttps://github.com/arunoda/meteor-cluster/issues/4#issuecomment-22994066 .

Arunoda Susiripala

@arunoda http://twitter.com/arunoda http://gplus.to/arunodahttps://github.com/arunoda http://www.linkedin.com/in/arunoda