search

palewire / django-calaccess-campaign-browser

A Django app to refine, review and republish campaign finance data drawn from the California Secretary of State’s CAL-ACCESS database
http://django-calaccess-campaign-browser.californiacivicdata.org
MIT License
17 stars 12 forks source link

`loadcampaignfinancefilers` never completes #54

Closed aboutaaron closed 10 years ago

aboutaaron commented 10 years ago

I don't know if something changed in my PEP8 refactor or when @palewire broke the mgmt command into modules but just he loadcampaignfinancefilers.py task just runs ad infinitum. I'm running cProfile on it so we'll see if I learn anything should it complete

aboutaaron commented 10 years ago

@mikejcorey ran into the same issue as well

palewire commented 10 years ago

It was doing the same thing for me before when it was in the management command.

palewire commented 10 years ago

sorry

A contributing factor may be that a bug I inserted into the loadcalaccessfile command resulted in some columns not being properly loaded into the database with a fresh download routine. I'm writing the fix now and will be shipping a new version of django-calaccess-raw-data to PyPI tonight. Next time you crack this guy open, upgrade your dependency and start fresh to see if there is any improvement.

palewire commented 10 years ago

I'm hacking this mofo hard over in the reload-rewrite branch, but one thing to be sure of is that you are actually using the source code and don't accidentally have the setup.py package installed in your site-packages. One way to make sure is to just hammer this real quick.

$ pip uninstall django-calaccess-campaign-browser
palewire commented 10 years ago

This will be fixed once I merge the loader-rewrite branch so I'm going to close it just to clear up our ticket pile a little.