Can we do bulk search query

matthaywardwebdesign / aus-search

A collection of Node JS scripts to create an Elasticsearch index of Australian addresses.

MIT License

81 stars 20 forks source link

Can we do bulk search query #12

Open ravibadoni opened 4 years ago

ravibadoni commented 4 years ago

Hi, I have 500,000 records to parse through aus search database. But i have used node stream that parse one by one record from elastic search GNAF data that take so much time to do that. Is there a way to do it fast. @matthaywardwebdesign Please suggest

matthaywardwebdesign commented 4 years ago

Hi @ravibadoni

Are you looking to do some form of bulk address validation, so effectively do a search on each one and get the first result?

ravibadoni commented 4 years ago

I have a csv file of 500,000 address. I want to verify it GNAF data elastic search.

SO should I pass each one to elastic search to get results, As this process stakes a long time. 1 records takes 500ms so 500,000 will take 3-5 days approx

@matthaywardwebdesign