Closed kasi45 closed 4 years ago
I have an idea. How about doing a PR and updating all the foreign scrapers to then utilize this new function...then we elect you to take control of the foreign scrapers? Nobody wants to deal with them, and frankly I don't have the time myself. This would be a great help to the OpenScrapers project!! If you decide to do this just please touch base with @Tikipeter as I believe he's doing an update as we speak.
Please transfer the following function "get_titles_for_search()" to the "source_utils.py
This function simplifies the writing of scrapres. It creates a list from the transferred values in which there are no more duplicates.
as an example you see some codelines from a scraper:
old:
new with "get_titles_for_search()"
many thanks