tools/dataProcessor.js currently does multiple web searches to map each discover cashback name to a hostname. Historically, this has been done with the Node.js Google package. However, this is no longer maintained and was not working correctly when I tried updating the Discover Cashback data. As mentioned in jprichardson/node-google#63, this is honestly not the best way to be doing Google Searches.
I looked into the Google Custom Search API, but that was expensive. For our use-case, I decided that the Bing Web Search API should suffice.
Testing Done
Validated raw data is correctly processed into the json files
Migrated from Node.js Google to Microsoft Cognitive Services' Bing Web Search v7.
Background
tools/dataProcessor.jscurrently does multiple web searches to map each discover cashback name to a hostname. Historically, this has been done with the Node.js Google package. However, this is no longer maintained and was not working correctly when I tried updating the Discover Cashback data. As mentioned in jprichardson/node-google#63, this is honestly not the best way to be doing Google Searches.I looked into the Google Custom Search API, but that was expensive. For our use-case, I decided that the Bing Web Search API should suffice.
Testing Done
Other changes