I encountered an issue with the hard limit of 999 pages in the scrape.py file. To address this, I have modified the code to set the limit to max 10k pages.
In addition, I noticed that the code only used PC4 for zip code information, even though PC6 information is available. To make use of this additional information, I have modified the preprocess.py file to allow saving 1234 AB (PC6) as a zip code versus just 1234 (PC4).
These changes will allow users to perform searches across multiple cities and provide more detailed location information. Thank you for considering my pull request.
I encountered an issue with the hard limit of 999 pages in the
scrape.pyfile. To address this, I have modified the code to set the limit to max 10k pages.In addition, I noticed that the code only used PC4 for zip code information, even though PC6 information is available. To make use of this additional information, I have modified the
preprocess.pyfile to allow saving 1234 AB (PC6) as a zip code versus just 1234 (PC4).These changes will allow users to perform searches across multiple cities and provide more detailed location information. Thank you for considering my pull request.