I think that most of the modern web for house searching will have directly API that we can call to get the info we want in a already formatted way. I think we should investigate this solution.
Pros
More stable, since API changes are less common then UI changes
Pre-formatted data format
Cleaner architecture
Cons
API limits?
BOT detection?
Extra toughts
I imagine an architecture where we can have a ModernNormalizer for each provider that in in charge of converting the different models for each provider into our common one, in this way we can manipulate the data easily in the backend.
The scraping part is an eventual fallback in case we don't have a public accessible API, or in case that reverting it will be to expensive.
Description
I think that most of the modern web for house searching will have directly API that we can call to get the info we want in a already formatted way. I think we should investigate this solution.
Pros
Cons
Extra toughts
I imagine an architecture where we can have a
ModernNormalizerfor each provider that in in charge of converting the different models for each provider into our common one, in this way we can manipulate the data easily in the backend. The scraping part is an eventual fallback in case we don't have a public accessible API, or in case that reverting it will be to expensive.