stevenmurphy12
commented
1 month ago I see the same issue on Dagster 1.7.14 when deployed to Kubernetes. Functionally it seems fine, I don't get the same issue locally
It appears to happen after each step in a pipeline run completes.
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/dagster/_core/execution/api.py", line 290, in ephemeral_instance_if_missing
yield ephemeral_instance
GeneratorExit
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/sqlalchemy/pool/base.py", line 986, in _finalize_fairy
fairy._reset(
File "/usr/local/lib/python3.9/site-packages/sqlalchemy/pool/base.py", line 1432, in _reset
pool._dialect.do_rollback(self)
File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 698, in do_rollback
dbapi_connection.rollback()
sqlite3.ProgrammingError: Cannot operate on a closed database.
Exception during reset or similar
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/dagster/_core/execution/api.py", line 290, in ephemeral_instance_if_missing
yield ephemeral_instance
GeneratorExit
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/sqlalchemy/pool/base.py", line 986, in _finalize_fairy
fairy._reset(
File "/usr/local/lib/python3.9/site-packages/sqlalchemy/pool/base.py", line 1432, in _reset
pool._dialect.do_rollback(self)
File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 698, in do_rollback
dbapi_connection.rollback()
sqlite3.ProgrammingError: Cannot operate on a closed database.
Exception during reset or similar
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/dagster/_core/execution/api.py", line 290, in ephemeral_instance_if_missing
yield ephemeral_instance
GeneratorExit
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/sqlalchemy/pool/base.py", line 986, in _finalize_fairy
fairy._reset(
File "/usr/local/lib/python3.9/site-packages/sqlalchemy/pool/base.py", line 1432, in _reset
pool._dialect.do_rollback(self)
File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 698, in do_rollback
dbapi_connection.rollback()
sqlite3.ProgrammingError: Cannot operate on a closed database.
Exception during reset or similar
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/dagster/_core/execution/api.py", line 290, in ephemeral_instance_if_missing
yield ephemeral_instance
GeneratorExit
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/sqlalchemy/pool/base.py", line 986, in _finalize_fairy
fairy._reset(
File "/usr/local/lib/python3.9/site-packages/sqlalchemy/pool/base.py", line 1432, in _reset
pool._dialect.do_rollback(self)
File "/usr/local/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 698, in do_rollback
dbapi_connection.rollback()
sqlite3.ProgrammingError: Cannot operate on a closed database.
Dagster version
dagster, version 1.6.1
What's the issue?
Everytime I run dagster locally I run into this error.
It doesn't affect dagster, like everything is working as expected, but I wonder why I see that error each time.
The same error is shown 9 times.
What did you expect to happen?
Not showing any errors.
How to reproduce?
For me it's running
dagster devorpyteston my dagster project.Deployment type
Local
Deployment details
No response
Additional information
No response
Message from the maintainers
Impacted by this issue? Give it a 👍! We factor engagement into prioritization.