search

jinwook-k / cc-scraper

💳 A npm pkg to get info about credit card points, categories, and cash-back calendars.
https://www.npmjs.com/package/cc-scraper
MIT License
3 stars 1 forks source link

Update Scraping filters and exclusions #38

Closed jinwook-k closed 4 years ago

jinwook-k commented 4 years ago

when a category involves special chars like commas or ampersands, getting the FAQ/terms and services get lost.

try to split by whitespace and also search for higher than 70% match rate to catch the FAQ?

Or include the commas and ampersand since there isn't much special chars to be an inclusive title?

jinwook-k commented 4 years ago

It seems like the FAQ category names are exact when it comes to including special chars like commas and ampersands. But it is not case sensitive