Closed DavidKelly-Praedictus closed 1 year ago
This is probably an issue of an older embedded sqlite version having more limited SQL syntax support in an older Python runtime. However, it is not an issue we face in production and there isn't enough diagnostic information captured here to really narrow down the offending query. The reported code is in a loop that generates and processes many different ETL queries across the whole portal model.
Closing because we aren't likely to investigate this further unless we encounter an easily reproducible failure with future test systems.
When running on Ubuntu 20.04, with either the python3.8 or python3.9 packages from the ubuntu repo, submission.ingest throws a sqlite3 syntax error.
The same data and cfde-deriva version works fine when using miniconda 4.10.3 (python 3.8). It seems like this is triggered by something in the python environment, but I haven't been able to narrow it down beyond that. This was tested using cfde-deriva commit 51f99c841506d25a5488eadb74351500e0055836.
Using miniconda solves everything for me, but I thought I should mention this as a potential issue.
And below is a list of the python modules in the standard 3.8 python virtual environment where it throws an error: