Scrapear actuaciones de legisladores

baje la rama:

feature/scrapping_politician_actions

LOAD DATA ERROR

Al ejecutar el load data con el fixture

python manage.py loaddata polisessions apps/polisessions/fixtures/actions_sessions.json

da el error:

IntegrityError: Problem installing fixture 'apps/polisessions/fixtures/actions_sessions.json': Could not load polisessions.Session(pk=1): null value in column "number" violates not-null constraint

Pero al ejecutar

scrapy crawl actions

Da error

2013-05-02 06:20:17-0300 [scrapy] INFO: Scrapy 0.16.4 started (bot: uy)
2013-05-02 06:20:18-0300 [scrapy] DEBUG: Enabled extensions: AutoThrottle, LogStats, TelnetConsole, CloseSpider, WebService, CoreStats, SpiderState
Traceback (most recent call last):
  File "/home/jfunez/Work/Environments/poliwall/bin/scrapy", line 4, in <module>
    execute()
  File "/home/jfunez/Work/Environments/poliwall/local/lib/python2.7/site-packages/scrapy/cmdline.py", line 131, in execute
    _run_print_help(parser, _run_command, cmd, args, opts)
  File "/home/jfunez/Work/Environments/poliwall/local/lib/python2.7/site-packages/scrapy/cmdline.py", line 76, in _run_print_help
    func(*a, **kw)
  File "/home/jfunez/Work/Environments/poliwall/local/lib/python2.7/site-packages/scrapy/cmdline.py", line 138, in _run_command
    cmd.run(args, opts)
  File "/home/jfunez/Work/Environments/poliwall/local/lib/python2.7/site-packages/scrapy/commands/crawl.py", line 43, in run
    spider = self.crawler.spiders.create(spname, **opts.spargs)
  File "/home/jfunez/Work/Environments/poliwall/local/lib/python2.7/site-packages/scrapy/command.py", line 33, in crawler
    self._crawler.configure()
  File "/home/jfunez/Work/Environments/poliwall/local/lib/python2.7/site-packages/scrapy/crawler.py", line 40, in configure
    self.spiders = spman_cls.from_crawler(self)
  File "/home/jfunez/Work/Environments/poliwall/local/lib/python2.7/site-packages/scrapy/spidermanager.py", line 35, in from_crawler
    sm = cls.from_settings(crawler.settings)
  File "/home/jfunez/Work/Environments/poliwall/local/lib/python2.7/site-packages/scrapy/spidermanager.py", line 31, in from_settings
    return cls(settings.getlist('SPIDER_MODULES'))
  File "/home/jfunez/Work/Environments/poliwall/local/lib/python2.7/site-packages/scrapy/spidermanager.py", line 22, in __init__
    for module in walk_modules(name):
  File "/home/jfunez/Work/Environments/poliwall/local/lib/python2.7/site-packages/scrapy/utils/misc.py", line 65, in walk_modules
    submod = __import__(fullpath, {}, {}, [''])
  File "/home/jfunez/Work/Code/poliwall/poliwall/poliwall/scrapping/uy/spiders/diem_spider.py", line 4, in <module>
ImportError: cannot import name Diem

jfunez / poliwall

Scrapear actuaciones de legisladores #9

LOAD DATA ERROR