search

sirensolutions / siren-join

[This is the old, single node version for Elasticsearch 2.x, see the latest "Siren Federate" plugin for distributed Elasticsearch 5.x and 6.x capabilities]
http://siren.io
GNU Affero General Public License v3.0
183 stars 60 forks source link

ES 5.x support? #108

Open cheruvian opened 8 years ago

cheruvian commented 8 years ago

Doesn't look like ES 5.x is supported.

turp1twin commented 8 years ago

I think I am going to give that a go, not sure how long it will take given my schedule and it looks like there have been quite a few API changes with 5.0.... Stop me now if this is already in the works.... Anyone? :-)

rendel commented 8 years ago

@turp1twin sure feel free to start attacking this issue ;o) I can provide support. I am already working on es 5.x, but for another plugin, so I might have already encountered the API changes that could cause issue. good luck !

turp1twin commented 8 years ago

Looks like this is going to be a bit of a bear, lots has changed. For one it looks like all shard level services for Plugins have been removed... Looks like there might be a way around it, but I haven't sorted that out yet. Did you happen to face any of this with the plugin you are porting to 5.0? Cheers!

Jeff

rendel commented 8 years ago

Indeed, shard plugin modules has been removed in https://github.com/elastic/elasticsearch/pull/13881. As they recommend, we should be able to use instead an index level service that will listen to shard lifecycle. The index level service will track a version number for multiple shards. It will have to use the IndexEventListener#afterIndexShardStarted and #afterIndexShardClosedapi to keep track on the available shards on the node. And for each shard, it will register a listener using the IndexingOperationListener api (as it is now). So yes there is a bit of work, as we need to move this shard level service to a node level service, and implement tracking on a per shards basis. If this looks to complicated, maybe you can just deactivate this service for the moment, and work on the rest of the code.

turp1twin commented 8 years ago

Thanks for the feedback, that definitely is the approach I am following. I am knee deep in it right now and will let you know how things progress. If I hit any snags I will let you know... Cheers!

Jeff

turp1twin commented 7 years ago

Still working on it, sorry for the delay... Got sidetracked with my day job... Will hopefully have it wrapped up soon...

Jeff

tomasfalt commented 7 years ago

Any plan to release this soon?

jccq commented 7 years ago

Best kept secret in industry... It's out as this morning :) see support.Siren.solutions for kibi 5.2

Announcement later today

On 26 Apr 2017 2:35 pm, "calicartel" notifications@github.com wrote:

Hello, is there an ETA on this? Thanks.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/sirensolutions/siren-join/issues/108#issuecomment-297410222, or mute the thread https://github.com/notifications/unsubscribe-auth/AEuGyHFSvkSewTEvIn7wBQBjAdjlesqkks5rz0gvgaJpZM4KimTE .

calicartel commented 7 years ago

Sorry, I am new to this so confirming that this means siren-join,too, and not just kibi?

mayurwish commented 7 years ago

We are currently using only Siren-Join as standalone plugin without Kibi for filter-join, not sure how can Kibi 5.2.2-beta-1 could let us use filter-join in our Java Project. what jar to include in our build.gradle?

jccq commented 7 years ago

please wait for the distribution

Giovanni Tummarello Siren Solutions - CEO T +353 91704885 | M +353 87 1272938 | giovanni@siren.solutions | http://siren.solutions/ Unit 13 GTC, Mervue Park, Galway, Ireland http://www.twitter.com/jccq?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature http://youtube.com/c/SirenSolutionsChannel?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature https://www.linkedin.com/in/giovannitummarello?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature

On Mon, May 8, 2017 at 12:23 AM, Mayur C Jain notifications@github.com wrote:

We are currently using only Siren-Join as standalone plugin without Kibi for filter-join, not sure how can Kibi 5.2.2-beta-1 could let us use filter-join in our Java Project. what jar to include in our build.gradle?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/sirensolutions/siren-join/issues/108#issuecomment-299743095, or mute the thread https://github.com/notifications/unsubscribe-auth/AEuGyNTx9xlM9JsEQEB-5OZ1R2nJboC1ks5r3lJggaJpZM4KimTE .

libenyang commented 7 years ago

@jccq hi，Is there a plan to be released?

tbw777 commented 7 years ago

waiting for release!

frozenspider commented 7 years ago

Waiting for it as well

martinduris commented 7 years ago

Any news guys ? Is it ready for ES 5.x ?

juanfmx2 commented 7 years ago

The distribution is . . . . . . not here yet. However, in a very tricky way, if you download kibi 5.2.2 standard (https://support.siren.solutions/support/solutions/articles/17000049505-kibi-5-2-2-beta-1-community-edition) you can get the plugin for elastic search 5.2.2. Just unzip it and inside the zip there is an elasticsearch 5.2.2 distribution with the plugin installed, or copy the plugin to your own elastic search distribution.

Sorry, spoke to soon, it does not work :(

rendel commented 7 years ago

@juanfmx2 all

While you can get our new plugin (called vanguard) from the kibi 5.2.2-beta-1 distribution, it is important to understand that this plugin is not open source and not licensed for commercial purposes. In other words, you can only use it for demo and not for commercial application.

We will clarify the licensing terms when we will do an official release.

mrdanadams commented 7 years ago

@rendel could you please clarify your comment about licensing above? ^

jccq commented 7 years ago

@mrdanadams we will soon have an official release with commercial terms. Likely 1st node is free, next ones require a licence, but to be finalized. Please write to info@siren.solutions for a commercial conversation.

mariusbalcytis commented 7 years ago

Will there be open-sourced support for ElasticSearch 5.x? It's been a month - we don't quite know where to go next, as upgrading to 5.x is needed for other reasons and they are beginning to stack together.

jccq commented 7 years ago

Hi Marius,

ES 5.x is covered by our new plugin Vanguard. Vanguard is a full rewrite to support a roadmap which will roll out in the next months featuers like fully distributed joins and federated queries with other backend system

We are distributing Vanguard as freemium: first data node free, with best effort support on the forum, the others covered by commercial licence with enterprise grade support (phone center 24/7 etc available).

Vanguard is available to be licenced standalone or as part of Kibi ( popular choice!)

this week we'll rollout the new website and all the info on this.

thanks

Giovanni Tummarello Siren Solutions - CEO T +353 91704885 | M +353 87 1272938 | giovanni@siren.solutions | http://siren.solutions/ Unit 13 GTC, Mervue Park, Galway, Ireland https://www.twitter.com/jccq?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature https://youtube.com/c/SirenSolutionsChannel?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature https://www.linkedin.com/in/giovannitummarello?utm_source=WiseStamp&utm_medium=email&utm_term=&utm_content=&utm_campaign=signature

On Wed, Aug 16, 2017 at 10:52 AM, Marius Balčytis notifications@github.com wrote:

Will there be open-sourced support for ElasticSearch 5.x? It's been a month - we don't quite know where to go next, as upgrading to 5.x is needed for other reasons and they are beginning to stack together.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/sirensolutions/siren-join/issues/108#issuecomment-322721998, or mute the thread https://github.com/notifications/unsubscribe-auth/AEuGyOGN7NCa6liwswZ9tfFGCkRB6gygks5sYrvkgaJpZM4KimTE .