search

moshe / elasticsearch_loader

A tool for batch loading data files (json, parquet, csv, tsv) into ElasticSearch
MIT License
399 stars 83 forks source link

Specific Keys of Json #67

Closed Indu-sharma closed 5 years ago

Indu-sharma commented 5 years ago

I'd wish to load only specific keys of json file to ES. Would it be able to support ? Example: json --keys a,b.c,d [json_files]

moshe commented 5 years ago

Hi @Indu-sharma, I have added --keys, you can try it in version 0.4.0. add the flag before the format (elasticsearch_loader --index indexname --keys key1,key2 json files.json) Let me know if it works for you (:

moshe commented 5 years ago

ping @Indu-sharma

Indu-sharma commented 5 years ago

Sure, Thanks a lot @moshe! One more ask, many times our ES document id needs to be the concatenation of two fields. Would that be possible to take care of? Thank you.

moshe commented 5 years ago

Yes, but it will wait until the next time I will have some free time. Feel free to make a pr (:

stale[bot] commented 5 years ago

This issue has been automatically marked as stale because it has not had recent activity (14 days). It will be closed if no further activity occurs in the next 7 days. Thank you for your contributions.

stale[bot] commented 5 years ago

This issue has been automatically closed because it has not had recent activity (21 days). Please reopen it if you feel that the issue not resolved yet.