I was working with this tool to export the CSV outputs to BigQuery. But the amount of data I managed was over 10GB/day, taking an hour to convert to CSV, so for speeding things up I added a JSON export, since the JSON output with . and @ is not compatible with BigQuery, I added flags to make it compatible.
Usage: es2csv_cli -b -l '_' -j {... normal parameters}
I was working with this tool to export the CSV outputs to BigQuery. But the amount of data I managed was over 10GB/day, taking an hour to convert to CSV, so for speeding things up I added a JSON export, since the JSON output with . and @ is not compatible with BigQuery, I added flags to make it compatible.
Usage:
es2csv_cli -b -l '_' -j {... normal parameters}
Any feedback or improvement, I can add it.