Ensure incremental ingestion is possible - Githubissues

AKST / Australian-Address-Boundaries-Land-Property-Price-Database

This is a database of geographic boundaries, addresses as well as land and property data (mostly NSW).

MIT License

2 stars 0 forks source link

Ensure incremental ingestion is possible #34

Open AKST opened 1 month ago

AKST commented 1 month ago

The datasets for the NSW VG are quite large and take a while to ingest, so there's a lot of value in making sure when new stats are published we don't repeat ingestion for all data ever published. This actually goes for more than just the NSW VG data but the various GIS APIs

Pipelines

NSW VG
- [ ] property sales
- [ ] land values
spatial NSW
- [ ] lots
- [ ] property's
environment NSW
- [ ] zoning data

This will take a long time to accomplish.