etewiah / property_web_builder

Create a fully featured real estate website on Rails in minutes! ⛺
https://propertywebbuilder.com
MIT License
544 stars 257 forks source link

Support for scraping data from other real estate websites #13

Open etewiah opened 7 years ago

etewiah commented 7 years ago

Another thing I've had people requesting is the ability to import data from a webpage url. Not everyone uses an MLS and sometimes this is the easiest way to migrate from another website provider where only a few properties are listed. I already looked into this and it will be a bit tricky. Some sites can't be scraped and each one that can be scraped will need some slightly different rules. It offers some interesting possibilities though so I will work on it. Eventually if there is enough demand it could be a useful distinguishing feature. It could even evolve to be a tool for monitoring changes in other listings across the web - particularly the price. Who knows. I'm open to suggestions and ideas.

etewiah commented 7 years ago

I've finally had some time to look at this. In the end I decided the functionality for scraping real estate data should be in a standalone project. For this reason I have started this project:

https://github.com/RealEstateWebTools/property_web_scraper

Right now it is quite a barebones project but over the coming weeks I will add support for more websites and improve the UI

onvos commented 5 years ago

Hello I am trying to import data from the following three websites Primary website https://caribbeanrealtors.com.mx/en/houses/sale/cancun/quintana+roo/i2o1?bprecio=7

Mirror websites that fit the definition of MLMs https://www.inmuebles24.com/inmobiliarias/caribbean-realtors_50126006-inmuebles.html

https://www.rentasyventas.com/inmobiliarias/caribbean-realtors/d667.html

Saludos B

etewiah commented 5 years ago

Hi @onvos, I'm busy at the moment with a few projects but when I get some time I will have a look to see if I can help.