Closed rkiddy closed 9 years ago
I think a strategy like this might work to speed up the loader, but ultimately I think the goal of this repository is to create master tables that are 1) complete and 2) based on broader conceptions than the arcane forms that are specific to California.
It may make most searches quicker if the tables were divided up. It occurred to me that they could be split by year or by form or both. It would be a lot of tables, but the database would not care.
I have experimented a bit with code that chops them up by year. Just FYI. The filings are split up by the year of the RPT_END value in the FILER_FILINGS_CD table, and then those filing ids are used to fill the other tables.