search

stanjdev / realyzer

A web application for real estate investors to determine a rental property's profitability (ROI). Creates a printable PDF report with images and a map of the property
https://realyzer.app/
4 stars 1 forks source link

Image scraper button from MLS URL doesn't seem to work in production deploy. 502 bad gateway... BUT WORKS a little later! not reliable... #15

Open stanjdev opened 3 years ago

stanjdev commented 3 years ago

address. search it on redfin, auto-populate photo, details. also a map. map on top of page. itemized breakdown two columns.

try: https://davidwalsh.name/run-scraping-api-phearjs

stanjdev commented 3 years ago

I can scrape basic simple images, stronger built websites like realtor.com will crash my scraper and entire site, zillow.com must be leading to a bot page verification site, but redfin works and other sites too.

Only problem is, every website is different. need logic to limit how many photos I want to display. cuz it's ANY photo. little icons, to house photos, social media icons. etc.