listeven989 / real-estate-deal-finder

throwing some specs on how to find the optimal solutions for SFH/APT investment deals in a given area
0 stars 1 forks source link

extract niche.com data #2

Open steven4354 opened 1 year ago

steven4354 commented 1 year ago

let's update this code to also update the niche table with the zip code, median income, and the other columns when a new zip code is used that isn't in the niche table yet

https://github.com/steven4354/real-estate-deal-finder/blob/main/scripts/populate-postgres-with-zillow-export.ts#L14

helpful code snippets

this has the pupeteer code that works to extract the niche.com html for a given zip code:

https://github.com/steven4354/real-estate-deal-finder/blob/main/scripts/extract-niche-html.ts

and you can use this to clean the html before sending to chatGPT api:

https://github.com/steven4354/real-estate-deal-finder/blob/main/scripts/clean-html.ts

this is the prompt you can use to extract the needed values from the cleaned html text

https://chatcraft.org/c/steven4354/v38FRLHwP2Dj01pR5WUVi

.env

i will DM the .env file. thanks!