search

elastic / stream2es

Stream data into ES (Wikipedia, Twitter, stdin, or other ESes)
355 stars 62 forks source link

In stdin mode, when _id (or id) is available in the document, use it for indexing #38

Closed BrunoBonacci closed 9 years ago

BrunoBonacci commented 9 years ago

Currently the stdin mode, doesn't support id. If the same file is streamed twice the documents will be duplicated in the index with auto-generated ids. This change allows stream2es to use the field _id or id when available in the streamed document for indexing purposes avoiding duplicates.

BrunoBonacci commented 9 years ago

Hi, do you have any ETA on when and whether this is going to be merged in?

drewr commented 9 years ago

Sorry for the delay here @BrunoBonacci. You can tell I don't check the PRs enough!

drewr commented 9 years ago

Invited you to be a collaborator so you don't have to wait!