palewire / django-calaccess-campaign-browser

A Django app to refine, review and republish campaign finance data drawn from the California Secretary of State’s CAL-ACCESS database
http://django-calaccess-campaign-browser.californiacivicdata.org
MIT License
17 stars 12 forks source link

tables could be partitioned by year and/or form #221

Closed rkiddy closed 9 years ago

rkiddy commented 9 years ago

It may make most searches quicker if the tables were divided up. It occurred to me that they could be split by year or by form or both. It would be a lot of tables, but the database would not care.

I have experimented a bit with code that chops them up by year. Just FYI. The filings are split up by the year of the RPT_END value in the FILER_FILINGS_CD table, and then those filing ids are used to fill the other tables.

table                              count

CVR2_CAMPAIGN_DISCLOSURE_CD        93185
CVR2_CAMPAIGN_DISCLOSURE_CD_2000    2504
CVR2_CAMPAIGN_DISCLOSURE_CD_2001    1823
CVR2_CAMPAIGN_DISCLOSURE_CD_2002    4452
CVR2_CAMPAIGN_DISCLOSURE_CD_2003    3118
CVR2_CAMPAIGN_DISCLOSURE_CD_2004    6524
CVR2_CAMPAIGN_DISCLOSURE_CD_2005    4098
CVR2_CAMPAIGN_DISCLOSURE_CD_2006    9956
CVR2_CAMPAIGN_DISCLOSURE_CD_2007    3921
CVR2_CAMPAIGN_DISCLOSURE_CD_2008    9028
CVR2_CAMPAIGN_DISCLOSURE_CD_2009    4633
CVR2_CAMPAIGN_DISCLOSURE_CD_2010   11737
CVR2_CAMPAIGN_DISCLOSURE_CD_2011    4737
CVR2_CAMPAIGN_DISCLOSURE_CD_2012   11003
CVR2_CAMPAIGN_DISCLOSURE_CD_2013    5345
CVR2_CAMPAIGN_DISCLOSURE_CD_2014   10165
CVR2_CAMPAIGN_DISCLOSURE_CD_2015     223
CVR2_CAMPAIGN_DISCLOSURE_CD_else      21

CVR2_LOBBY_DISCLOSURE_CD        87356
CVR2_LOBBY_DISCLOSURE_CD_2000    2842
CVR2_LOBBY_DISCLOSURE_CD_2001    4416
CVR2_LOBBY_DISCLOSURE_CD_2002    4700
CVR2_LOBBY_DISCLOSURE_CD_2003    4789
CVR2_LOBBY_DISCLOSURE_CD_2004    4843
CVR2_LOBBY_DISCLOSURE_CD_2005    5241
CVR2_LOBBY_DISCLOSURE_CD_2006    5420
CVR2_LOBBY_DISCLOSURE_CD_2007    5722
CVR2_LOBBY_DISCLOSURE_CD_2008    5168
CVR2_LOBBY_DISCLOSURE_CD_2009    5598
CVR2_LOBBY_DISCLOSURE_CD_2010    5529
CVR2_LOBBY_DISCLOSURE_CD_2011    7784
CVR2_LOBBY_DISCLOSURE_CD_2012    8092
CVR2_LOBBY_DISCLOSURE_CD_2013    8856
CVR2_LOBBY_DISCLOSURE_CD_2014    8690
CVR2_LOBBY_DISCLOSURE_CD_2015      17
CVR2_LOBBY_DISCLOSURE_CD_else      81

CVR2_REGISTRATION_CD         85498
CVR2_REGISTRATION_CD_2000      955
CVR2_REGISTRATION_CD_2001     2096
CVR2_REGISTRATION_CD_2002     5770
CVR2_REGISTRATION_CD_2003     3210
CVR2_REGISTRATION_CD_2004    10852
CVR2_REGISTRATION_CD_2005     9877
CVR2_REGISTRATION_CD_2006    17126
CVR2_REGISTRATION_CD_2007    10774
CVR2_REGISTRATION_CD_2008    20508
CVR2_REGISTRATION_CD_2009    12202
CVR2_REGISTRATION_CD_2010    24204
CVR2_REGISTRATION_CD_2011    13627
CVR2_REGISTRATION_CD_2012    22940
CVR2_REGISTRATION_CD_2013    15491
CVR2_REGISTRATION_CD_2014    18968
CVR2_REGISTRATION_CD_2015     4629
CVR2_REGISTRATION_CD_else      756

CVR2_SO_CD         34325
CVR2_SO_CD_2000      234
CVR2_SO_CD_2001     1000
CVR2_SO_CD_2002     1497
CVR2_SO_CD_2003     2715
CVR2_SO_CD_2004     3503
CVR2_SO_CD_2005     3489
CVR2_SO_CD_2006     4918
CVR2_SO_CD_2007     4404
CVR2_SO_CD_2008     7992
CVR2_SO_CD_2009    17515
CVR2_SO_CD_2010    10790
CVR2_SO_CD_2011    10679
CVR2_SO_CD_2012    14544
CVR2_SO_CD_2013    15666
CVR2_SO_CD_2014    11258
CVR2_SO_CD_2015     4375
CVR2_SO_CD_else      272

CVR3_VERIFICATION_INFO_CD        211655
CVR3_VERIFICATION_INFO_CD_2000     7685
CVR3_VERIFICATION_INFO_CD_2001     7671
CVR3_VERIFICATION_INFO_CD_2002    13481
CVR3_VERIFICATION_INFO_CD_2003    10435
CVR3_VERIFICATION_INFO_CD_2004    15883
CVR3_VERIFICATION_INFO_CD_2005    11369
CVR3_VERIFICATION_INFO_CD_2006    20562
CVR3_VERIFICATION_INFO_CD_2007    11556
CVR3_VERIFICATION_INFO_CD_2008    21787
CVR3_VERIFICATION_INFO_CD_2009    17421
CVR3_VERIFICATION_INFO_CD_2010    24465
CVR3_VERIFICATION_INFO_CD_2011    14576
CVR3_VERIFICATION_INFO_CD_2012    26933
CVR3_VERIFICATION_INFO_CD_2013    17587
CVR3_VERIFICATION_INFO_CD_2014    24868
CVR3_VERIFICATION_INFO_CD_2015     2293
CVR3_VERIFICATION_INFO_CD_else      231

CVR_CAMPAIGN_DISCLOSURE_CD        330593
CVR_CAMPAIGN_DISCLOSURE_CD_2000    13766
CVR_CAMPAIGN_DISCLOSURE_CD_2001     7120
CVR_CAMPAIGN_DISCLOSURE_CD_2002    24082
CVR_CAMPAIGN_DISCLOSURE_CD_2003    10114
CVR_CAMPAIGN_DISCLOSURE_CD_2004    24741
CVR_CAMPAIGN_DISCLOSURE_CD_2005    12452
CVR_CAMPAIGN_DISCLOSURE_CD_2006    35909
CVR_CAMPAIGN_DISCLOSURE_CD_2007     9001
CVR_CAMPAIGN_DISCLOSURE_CD_2008    31362
CVR_CAMPAIGN_DISCLOSURE_CD_2009    10396
CVR_CAMPAIGN_DISCLOSURE_CD_2010    35645
CVR_CAMPAIGN_DISCLOSURE_CD_2011     9023
CVR_CAMPAIGN_DISCLOSURE_CD_2012    35559
CVR_CAMPAIGN_DISCLOSURE_CD_2013    15840
CVR_CAMPAIGN_DISCLOSURE_CD_2014    52500
CVR_CAMPAIGN_DISCLOSURE_CD_2015     2208
CVR_CAMPAIGN_DISCLOSURE_CD_else     2648

CVR_E530_CD        190
CVR_E530_CD_2000     0
CVR_E530_CD_2001     0
CVR_E530_CD_2002     0
CVR_E530_CD_2003     5
CVR_E530_CD_2004     0
CVR_E530_CD_2005     0
CVR_E530_CD_2006    67
CVR_E530_CD_2007     2
CVR_E530_CD_2008    11
CVR_E530_CD_2009     0
CVR_E530_CD_2010    59
CVR_E530_CD_2011     0
CVR_E530_CD_2012     5
CVR_E530_CD_2013     0
CVR_E530_CD_2014    42
CVR_E530_CD_2015     0
CVR_E530_CD_else     1

CVR_LOBBY_DISCLOSURE_CD        192307
CVR_LOBBY_DISCLOSURE_CD_2000     7028
CVR_LOBBY_DISCLOSURE_CD_2001    13990
CVR_LOBBY_DISCLOSURE_CD_2002    14710
CVR_LOBBY_DISCLOSURE_CD_2003    14982
CVR_LOBBY_DISCLOSURE_CD_2004    15534
CVR_LOBBY_DISCLOSURE_CD_2005    16673
CVR_LOBBY_DISCLOSURE_CD_2006    17520
CVR_LOBBY_DISCLOSURE_CD_2007    18326
CVR_LOBBY_DISCLOSURE_CD_2008    18033
CVR_LOBBY_DISCLOSURE_CD_2009    17704
CVR_LOBBY_DISCLOSURE_CD_2010    18143
CVR_LOBBY_DISCLOSURE_CD_2011    19389
CVR_LOBBY_DISCLOSURE_CD_2012       59
CVR_LOBBY_DISCLOSURE_CD_2013        1
CVR_LOBBY_DISCLOSURE_CD_2014        0
CVR_LOBBY_DISCLOSURE_CD_2015        0
CVR_LOBBY_DISCLOSURE_CD_else      750

CVR_REGISTRATION_CD        41423
CVR_REGISTRATION_CD_2000     166
CVR_REGISTRATION_CD_2001     636
CVR_REGISTRATION_CD_2002    1689
CVR_REGISTRATION_CD_2003     750
CVR_REGISTRATION_CD_2004    3649
CVR_REGISTRATION_CD_2005    3018
CVR_REGISTRATION_CD_2006    5802
CVR_REGISTRATION_CD_2007    3501
CVR_REGISTRATION_CD_2008    6702
CVR_REGISTRATION_CD_2009    3126
CVR_REGISTRATION_CD_2010    7365
CVR_REGISTRATION_CD_2011    4017
CVR_REGISTRATION_CD_2012    7875
CVR_REGISTRATION_CD_2013    4418
CVR_REGISTRATION_CD_2014    6663
CVR_REGISTRATION_CD_2015    1752
CVR_REGISTRATION_CD_else     128

CVR_SO_CD        13819
CVR_SO_CD_2000     143
CVR_SO_CD_2001     448
CVR_SO_CD_2002     722
CVR_SO_CD_2003    1265
CVR_SO_CD_2004    1540
CVR_SO_CD_2005    1489
CVR_SO_CD_2006    1885
CVR_SO_CD_2007    1910
CVR_SO_CD_2008    3261
CVR_SO_CD_2009    6302
CVR_SO_CD_2010    3810
CVR_SO_CD_2011    3858
CVR_SO_CD_2012    5098
CVR_SO_CD_2013    5506
CVR_SO_CD_2014    3899
CVR_SO_CD_2015    1496
CVR_SO_CD_else     109

DEBT_CD        393905
DEBT_CD_2000    19644
DEBT_CD_2001    10311
DEBT_CD_2002    23590
DEBT_CD_2003    18559
DEBT_CD_2004    26061
DEBT_CD_2005    17989
DEBT_CD_2006    41987
DEBT_CD_2007    12736
DEBT_CD_2008    37996
DEBT_CD_2009    18324
DEBT_CD_2010    50999
DEBT_CD_2011    12717
DEBT_CD_2012    40443
DEBT_CD_2013    20244
DEBT_CD_2014    42149
DEBT_CD_2015      538
DEBT_CD_else       81

EXPN_CD        4581759
EXPN_CD_2000    259110
EXPN_CD_2001    149527
EXPN_CD_2002    330485
EXPN_CD_2003    191309
EXPN_CD_2004    341558
EXPN_CD_2005    266265
EXPN_CD_2006    449408
EXPN_CD_2007    183055
EXPN_CD_2008    437468
EXPN_CD_2009    241249
EXPN_CD_2010    491894
EXPN_CD_2011    165107
EXPN_CD_2012    427153
EXPN_CD_2013    224272
EXPN_CD_2014    424580
EXPN_CD_2015      6666
EXPN_CD_else      1144

F495P2_CD         893
F495P2_CD_2000      0
F495P2_CD_2001     15
F495P2_CD_2002      4
F495P2_CD_2003    118
F495P2_CD_2004     11
F495P2_CD_2005    141
F495P2_CD_2006     36
F495P2_CD_2007     54
F495P2_CD_2008     82
F495P2_CD_2009    104
F495P2_CD_2010    112
F495P2_CD_2011     54
F495P2_CD_2012     15
F495P2_CD_2013    116
F495P2_CD_2014     15
F495P2_CD_2015     17
F495P2_CD_else      0

F501_502_CD       14999
F501_502_CD_2000   3254
F501_502_CD_2001     50
F501_502_CD_2002      0
F501_502_CD_2003      0
F501_502_CD_2004      0
F501_502_CD_2005      0
F501_502_CD_2006      0
F501_502_CD_2007      0
F501_502_CD_2008      0
F501_502_CD_2009      0
F501_502_CD_2010      0
F501_502_CD_2011      0
F501_502_CD_2012      0
F501_502_CD_2013      0
F501_502_CD_2014      0
F501_502_CD_2015      0
F501_502_CD_else  11639

F690P2_CD        16889
F690P2_CD_2000     178
F690P2_CD_2001     457
F690P2_CD_2002     445
F690P2_CD_2003     756
F690P2_CD_2004     709
F690P2_CD_2005    1078
F690P2_CD_2006    1064
F690P2_CD_2007    1594
F690P2_CD_2008    1030
F690P2_CD_2009    1327
F690P2_CD_2010    1501
F690P2_CD_2011    1901
F690P2_CD_2012    1595
F690P2_CD_2013    2139
F690P2_CD_2014    1393
F690P2_CD_2015      18
F690P2_CD_else      45

FILER_FILINGS_CD       1790105
FILER_FILINGS_CD_2000    58549
FILER_FILINGS_CD_2001    51727
FILER_FILINGS_CD_2002    74758
FILER_FILINGS_CD_2003    54831
FILER_FILINGS_CD_2004    76827
FILER_FILINGS_CD_2005    44824
FILER_FILINGS_CD_2006    79277
FILER_FILINGS_CD_2007    40969
FILER_FILINGS_CD_2008    74776
FILER_FILINGS_CD_2009    43555
FILER_FILINGS_CD_2010    80688
FILER_FILINGS_CD_2011    44134
FILER_FILINGS_CD_2012    83213
FILER_FILINGS_CD_2013    53688
FILER_FILINGS_CD_2014    98128
FILER_FILINGS_CD_2015     4035
FILER_FILINGS_CD_else   826212

FILINGS_CD       1666194
FILINGS_CD_2000    55312
FILINGS_CD_2001    48479
FILINGS_CD_2002    68874
FILINGS_CD_2003    50636
FILINGS_CD_2004    69824
FILINGS_CD_2005    39609
FILINGS_CD_2006    70625
FILINGS_CD_2007    35729
FILINGS_CD_2008    65791
FILINGS_CD_2009    37814
FILINGS_CD_2010    70346
FILINGS_CD_2011    38696
FILINGS_CD_2012    73375
FILINGS_CD_2013    47324
FILINGS_CD_2014    90162
FILINGS_CD_2015     3628
FILINGS_CD_else   806161

HDR_CD        638389
HDR_CD_2000    16304
HDR_CD_2001    22167
HDR_CD_2002    41211
HDR_CD_2003    27118
HDR_CD_2004    45470
HDR_CD_2005    33641
HDR_CD_2006    61136
HDR_CD_2007    32748
HDR_CD_2008    59373
HDR_CD_2009    37556
HDR_CD_2010    65036
HDR_CD_2011    38025
HDR_CD_2012    70131
HDR_CD_2013    48044
HDR_CD_2014    85748
HDR_CD_2015     5514
HDR_CD_else      521

LATT_CD        66745
LATT_CD_2000    1524
LATT_CD_2001    2719
LATT_CD_2002    3770
LATT_CD_2003    3344
LATT_CD_2004    4088
LATT_CD_2005    4055
LATT_CD_2006    5617
LATT_CD_2007    4495
LATT_CD_2008    5919
LATT_CD_2009    4610
LATT_CD_2010    5633
LATT_CD_2011    5521
LATT_CD_2012    5841
LATT_CD_2013    4638
LATT_CD_2014    5209
LATT_CD_2015       0
LATT_CD_else      24

LCCM_CD        84620
LCCM_CD_2000    6180
LCCM_CD_2001    3670
LCCM_CD_2002    9177
LCCM_CD_2003    3713
LCCM_CD_2004    8432
LCCM_CD_2005    3270
LCCM_CD_2006    7324
LCCM_CD_2007    3788
LCCM_CD_2008    7299
LCCM_CD_2009    4154
LCCM_CD_2010    7290
LCCM_CD_2011    3603
LCCM_CD_2012    7146
LCCM_CD_2013    3431
LCCM_CD_2014    6318
LCCM_CD_2015       0
LCCM_CD_else    1754

LEMP_CD        247114
LEMP_CD_2000     3700
LEMP_CD_2001    12733
LEMP_CD_2002    26004
LEMP_CD_2003    14274
LEMP_CD_2004    33704
LEMP_CD_2005    33667
LEMP_CD_2006    62193
LEMP_CD_2007    43912
LEMP_CD_2008    78011
LEMP_CD_2009    50962
LEMP_CD_2010    86607
LEMP_CD_2011    43213
LEMP_CD_2012    73851
LEMP_CD_2013    47845
LEMP_CD_2014    48097
LEMP_CD_2015    10004
LEMP_CD_else     6147

LEXP_CD        166523
LEXP_CD_2000     5446
LEXP_CD_2001     9251
LEXP_CD_2002     9361
LEXP_CD_2003    11654
LEXP_CD_2004    11437
LEXP_CD_2005    13020
LEXP_CD_2006    12470
LEXP_CD_2007    14765
LEXP_CD_2008     9725
LEXP_CD_2009    11832
LEXP_CD_2010     8559
LEXP_CD_2011    10196
LEXP_CD_2012    12527
LEXP_CD_2013    14143
LEXP_CD_2014    12411
LEXP_CD_2015        0
LEXP_CD_else       20

LOAN_CD        66141
LOAN_CD_2000    4117
LOAN_CD_2001    2860
LOAN_CD_2002    6762
LOAN_CD_2003    3410
LOAN_CD_2004    4899
LOAN_CD_2005    2710
LOAN_CD_2006    5985
LOAN_CD_2007    2768
LOAN_CD_2008    7705
LOAN_CD_2009    2694
LOAN_CD_2010    6235
LOAN_CD_2011    2617
LOAN_CD_2012    5568
LOAN_CD_2013    2411
LOAN_CD_2014    5388
LOAN_CD_2015      76
LOAN_CD_else      30

LOBBYIST_FIRM_EMPLOYER1_CD       170
LOBBYIST_FIRM_EMPLOYER1_CD_2000    0
LOBBYIST_FIRM_EMPLOYER1_CD_2001  170
LOBBYIST_FIRM_EMPLOYER1_CD_2002    0
LOBBYIST_FIRM_EMPLOYER1_CD_2003    0
LOBBYIST_FIRM_EMPLOYER1_CD_2004    0
LOBBYIST_FIRM_EMPLOYER1_CD_2005    0
LOBBYIST_FIRM_EMPLOYER1_CD_2006    0
LOBBYIST_FIRM_EMPLOYER1_CD_2007    0
LOBBYIST_FIRM_EMPLOYER1_CD_2008    0
LOBBYIST_FIRM_EMPLOYER1_CD_2009    0
LOBBYIST_FIRM_EMPLOYER1_CD_2010    0
LOBBYIST_FIRM_EMPLOYER1_CD_2011    0
LOBBYIST_FIRM_EMPLOYER1_CD_2012    0
LOBBYIST_FIRM_EMPLOYER1_CD_2013    0
LOBBYIST_FIRM_EMPLOYER1_CD_2014    0
LOBBYIST_FIRM_EMPLOYER1_CD_2015    0
LOBBYIST_FIRM_EMPLOYER1_CD_else    0

LOBBYIST_FIRM_EMPLOYER2_CD       170
LOBBYIST_FIRM_EMPLOYER2_CD_2000    0
LOBBYIST_FIRM_EMPLOYER2_CD_2001  170
LOBBYIST_FIRM_EMPLOYER2_CD_2002    0
LOBBYIST_FIRM_EMPLOYER2_CD_2003    0
LOBBYIST_FIRM_EMPLOYER2_CD_2004    0
LOBBYIST_FIRM_EMPLOYER2_CD_2005    0
LOBBYIST_FIRM_EMPLOYER2_CD_2006    0
LOBBYIST_FIRM_EMPLOYER2_CD_2007    0
LOBBYIST_FIRM_EMPLOYER2_CD_2008    0
LOBBYIST_FIRM_EMPLOYER2_CD_2009    0
LOBBYIST_FIRM_EMPLOYER2_CD_2010    0
LOBBYIST_FIRM_EMPLOYER2_CD_2011    0
LOBBYIST_FIRM_EMPLOYER2_CD_2012    0
LOBBYIST_FIRM_EMPLOYER2_CD_2013    0
LOBBYIST_FIRM_EMPLOYER2_CD_2014    0
LOBBYIST_FIRM_EMPLOYER2_CD_2015    0
LOBBYIST_FIRM_EMPLOYER2_CD_else    0

LOBBY_AMENDMENTS_CD         9886
LOBBY_AMENDMENTS_CD_2000      94
LOBBY_AMENDMENTS_CD_2001     341
LOBBY_AMENDMENTS_CD_2002     745
LOBBY_AMENDMENTS_CD_2003     433
LOBBY_AMENDMENTS_CD_2004    1223
LOBBY_AMENDMENTS_CD_2005    1122
LOBBY_AMENDMENTS_CD_2006    2285
LOBBY_AMENDMENTS_CD_2007    1720
LOBBY_AMENDMENTS_CD_2008    2812
LOBBY_AMENDMENTS_CD_2009    1724
LOBBY_AMENDMENTS_CD_2010    3199
LOBBY_AMENDMENTS_CD_2011    1823
LOBBY_AMENDMENTS_CD_2012    3131
LOBBY_AMENDMENTS_CD_2013    2019
LOBBY_AMENDMENTS_CD_2014    2056
LOBBY_AMENDMENTS_CD_2015     426
LOBBY_AMENDMENTS_CD_else     112

LOTH_CD       12592
LOTH_CD_2000    683
LOTH_CD_2001    611
LOTH_CD_2002    578
LOTH_CD_2003    654
LOTH_CD_2004    681
LOTH_CD_2005    833
LOTH_CD_2006    841
LOTH_CD_2007    905
LOTH_CD_2008    752
LOTH_CD_2009    786
LOTH_CD_2010   1056
LOTH_CD_2011   1030
LOTH_CD_2012    962
LOTH_CD_2013   1090
LOTH_CD_2014   1135
LOTH_CD_2015      0
LOTH_CD_else      2

LPAY_CD        367966
LPAY_CD_2000    14477
LPAY_CD_2001    23015
LPAY_CD_2002    25154
LPAY_CD_2003    24953
LPAY_CD_2004    25685
LPAY_CD_2005    28021
LPAY_CD_2006    30325
LPAY_CD_2007    31313
LPAY_CD_2008    30135
LPAY_CD_2009    29778
LPAY_CD_2010    30312
LPAY_CD_2011    30115
LPAY_CD_2012    29331
LPAY_CD_2013    16594
LPAY_CD_2014       23
LPAY_CD_2015        0
LPAY_CD_else      178

RCPT_CD        8771080
RCPT_CD_2000    479026
RCPT_CD_2001    327949
RCPT_CD_2002    570546
RCPT_CD_2003    541598
RCPT_CD_2004    608906
RCPT_CD_2005    635405
RCPT_CD_2006    757677
RCPT_CD_2007    534114
RCPT_CD_2008   1094665
RCPT_CD_2009    556856
RCPT_CD_2010    664580
RCPT_CD_2011    413956
RCPT_CD_2012    628492
RCPT_CD_2013    419600
RCPT_CD_2014    551434
RCPT_CD_2015      5517
RCPT_CD_else      2454

RECEIVED_FILINGS_CD        375355
RECEIVED_FILINGS_CD_2000    21064
RECEIVED_FILINGS_CD_2001    21933
RECEIVED_FILINGS_CD_2002    40624
RECEIVED_FILINGS_CD_2003    23678
RECEIVED_FILINGS_CD_2004    23201
RECEIVED_FILINGS_CD_2005    14917
RECEIVED_FILINGS_CD_2006    29005
RECEIVED_FILINGS_CD_2007    11845
RECEIVED_FILINGS_CD_2008    24791
RECEIVED_FILINGS_CD_2009    12141
RECEIVED_FILINGS_CD_2010    26836
RECEIVED_FILINGS_CD_2011    11123
RECEIVED_FILINGS_CD_2012    27665
RECEIVED_FILINGS_CD_2013    14776
RECEIVED_FILINGS_CD_2014    37432
RECEIVED_FILINGS_CD_2015     2368
RECEIVED_FILINGS_CD_else      214

S401_CD        40727
S401_CD_2000    5720
S401_CD_2001    1013
S401_CD_2002    4851
S401_CD_2003    1323
S401_CD_2004    3681
S401_CD_2005    1120
S401_CD_2006    3532
S401_CD_2007     621
S401_CD_2008    3244
S401_CD_2009     778
S401_CD_2010    5988
S401_CD_2011     949
S401_CD_2012    3224
S401_CD_2013    1153
S401_CD_2014    3573
S401_CD_2015      37
S401_CD_else       0

S496_CD        34214
S496_CD_2000     664
S496_CD_2001     128
S496_CD_2002    1518
S496_CD_2003     444
S496_CD_2004    2292
S496_CD_2005    3178
S496_CD_2006    3374
S496_CD_2007     425
S496_CD_2008    3261
S496_CD_2009     557
S496_CD_2010    3822
S496_CD_2011     359
S496_CD_2012    6092
S496_CD_2013    1409
S496_CD_2014    6862
S496_CD_2015    1163
S496_CD_else     129

S497_CD        563859
S497_CD_2000    14819
S497_CD_2001     6882
S497_CD_2002    45167
S497_CD_2003    14595
S497_CD_2004    36863
S497_CD_2005    19186
S497_CD_2006    63577
S497_CD_2007    12475
S497_CD_2008    91881
S497_CD_2009    22534
S497_CD_2010    66112
S497_CD_2011     7361
S497_CD_2012    53136
S497_CD_2013    19414
S497_CD_2014    86496
S497_CD_2015     4253
S497_CD_else     6821

S498_CD        9173
S498_CD_2000    282
S498_CD_2001    114
S498_CD_2002    766
S498_CD_2003     97
S498_CD_2004    464
S498_CD_2005    137
S498_CD_2006    634
S498_CD_2007     14
S498_CD_2008    642
S498_CD_2009     94
S498_CD_2010    914
S498_CD_2011     52
S498_CD_2012    469
S498_CD_2013    352
S498_CD_2014   3987
S498_CD_2015    116
S498_CD_else      0

SMRY_CD        7528179
SMRY_CD_2000    234316
SMRY_CD_2001    305196
SMRY_CD_2002    428363
SMRY_CD_2003    357227
SMRY_CD_2004    490799
SMRY_CD_2005    404339
SMRY_CD_2006    627027
SMRY_CD_2007    440196
SMRY_CD_2008    647593
SMRY_CD_2009    452491
SMRY_CD_2010    690683
SMRY_CD_2011    474098
SMRY_CD_2012    741261
SMRY_CD_2013    514488
SMRY_CD_2014    722394
SMRY_CD_2015      8020
SMRY_CD_else      7774

SPLT_CD        3041392
SPLT_CD_2000       937
SPLT_CD_2001     55764
SPLT_CD_2002    264876
SPLT_CD_2003    212737
SPLT_CD_2004    254055
SPLT_CD_2005    215017
SPLT_CD_2006    441261
SPLT_CD_2007    120731
SPLT_CD_2008    242944
SPLT_CD_2009    154594
SPLT_CD_2010    365412
SPLT_CD_2011     99950
SPLT_CD_2012    242780
SPLT_CD_2013    127699
SPLT_CD_2014    243933
SPLT_CD_2015      3688
SPLT_CD_else        73

TEXT_MEMO_CD        533399
TEXT_MEMO_CD_2000    85349
TEXT_MEMO_CD_2001    55135
TEXT_MEMO_CD_2002    59748
TEXT_MEMO_CD_2003    61512
TEXT_MEMO_CD_2004    97775
TEXT_MEMO_CD_2005    81189
TEXT_MEMO_CD_2006    98721
TEXT_MEMO_CD_2007     4257
TEXT_MEMO_CD_2008     2024
TEXT_MEMO_CD_2009      106
TEXT_MEMO_CD_2010      731
TEXT_MEMO_CD_2011       36
TEXT_MEMO_CD_2012       21
TEXT_MEMO_CD_2013       60
TEXT_MEMO_CD_2014       37
TEXT_MEMO_CD_2015       10
TEXT_MEMO_CD_else       54
palewire commented 9 years ago

I think a strategy like this might work to speed up the loader, but ultimately I think the goal of this repository is to create master tables that are 1) complete and 2) based on broader conceptions than the arcane forms that are specific to California.