search

open-contracting / kingfisher-summarize

Creates SQL tables that summarize the OCDS data in collections from Kingfisher Process
https://kingfisher-summarize.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
3 stars 8 forks source link

Decide whether to auto-enable --tables-only for large collections #207

Open jpmckinney opened 3 years ago

jpmckinney commented 3 years ago

The performance of persistent tables (and materialized views) is better than views, especially when the views' underlying query is complex. The downside is that tables use more disk space.

In practice, I don't know what the threshold is, past which the performance is so degraded that it is worth using the extra disk space. I'll just log the issue for now.