Closed IanHopkinson closed 9 years ago
This usually means out of disk or a misnamed or corrupted file or something like that, in my experience. Can you give more detail? Is there any more information available?
Is the bug reproducible, and can you reproduce it in more than one place?
I've reproduced the bug in multiple boxes on the platform. I'll try to reproduce on my Windows machine and make a minimal failing case.
Ah, the interesting part is sqlalchemy.exc.OperationalError: no such table
(missed from the issue title and body). Then we need to figure out why table creation isn't happening.
I was running the database writes inside a dshelpers
batchprocessor when I disabled the batchprocessor I revealed a different error - I had specified columns with names Date_scraped
and date_scraped
which sqlalchemy identified as duplicates. Fixing this and re-applying the batchprocessor seems to have resolved the original problem.
As described in this issue:
https://bitbucket.org/scraperwikids/contract-finder/issues/2/sqlalchemyexcoperationalerror-for-most
This scraper fails on:
For version 0.5.1 with an error that begins:
sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) no such table: details [SQL: