search

timendez / go-redfin-archiver

Tool to download a Redfin listing
14 stars 2 forks source link

Only downloading a few images #6

Open rikrdo89 opened 4 months ago

rikrdo89 commented 4 months ago

It looks like redfin recently has updated their user interface, and maybe the way they are delivering content. This tools used to work well, but know it is only downloading a few images (3-4) instead of all of them for a given URL.

timendez commented 3 months ago

Thank you for the report @rikrdo89! I probably wont be able to get to it for a bit, but it's on my radar! 👍

hansdg1 commented 2 months ago

Actually, I just tried the script and it worked fine for me. It downloaded all 25 pictures from a listing.

timendez commented 1 month ago

Thanks for the update @hansdg1!

@rikrdo89 do you happen to have an example URL where it fails?

VeniXuan commented 3 weeks ago

Hi timendez, thanks for the super helpful tool! here's an example

go run archive.go https://www.redfin.com/WA/Bellevue/4717-130th-Ave-SE-98006/home/237687

it only downloads two image for me.

timendez commented 2 days ago

Hi timendez, thanks for the super helpful tool! here's an example

go run archive.go https://www.redfin.com/WA/Bellevue/4717-130th-Ave-SE-98006/home/237687

it only downloads two image for me.

I am able to download the entire archive image

Perhaps you're getting 429'd by Redfin for too much usage?

Try running it in debug mode:

go run archive.go https://www.redfin.com/WA/Bellevue/4717-130th-Ave-SE-98006/home/237687 debug

It will spew out each image request, and show you which ones failed for which reason. I'm curious to see if it's even attempting to download them for you and getting 429'd, or if it's A/B testing a different page layout that Go Redfin Archiver can't handle 🤔