elastic / stream2es

Stream data into ES (Wikipedia, Twitter, stdin, or other ESes)
355 stars 60 forks source link

Don't pass meta fields through source root #33

Closed drewr closed 10 years ago

drewr commented 10 years ago

Right now we add _id, _type, _routing, etc. to the stream's doc source root so that they can be read at index time. This isn't very elegant, and can step on fields that are named the same. We can still ship them in the source, but hide them in an inner object with a special name that we can be sure to remove during indexing.