But in version 0.9.9a0, this flow is broken due to missing dependency dlt[sql_database]. The same flow now gives the following error:
Traceback (most recent call last):
File "/Users/rahul/Desktop/tutorial_sql_database/remove/env/lib/python3.11/site-packages/dlt/common/libs/sql_alchemy.py", line 5, in <module>
from sqlalchemy import MetaData, Table, Column, create_engine
ModuleNotFoundError: No module named 'sqlalchemy'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/Users/rahul/Desktop/tutorial_sql_database/remove/sql_database_pipeline.py", line 10, in <module>
from dlt.sources.sql_database import sql_database, sql_table, Table
File "/Users/rahul/Desktop/tutorial_sql_database/remove/env/lib/python3.11/site-packages/dlt/sources/sql_database/__init__.py", line 5, in <module>
from dlt.common.libs.sql_alchemy import MetaData, Table, Engine
File "/Users/rahul/Desktop/tutorial_sql_database/remove/env/lib/python3.11/site-packages/dlt/common/libs/sql_alchemy.py", line 12, in <module>
raise MissingDependencyException(
dlt.common.exceptions.MissingDependencyException:
You must install additional dependencies to run dlt sql_database helpers . If you use pip you may do the following:
pip install "dlt[sql_database]"
Install the sql_database helpers for loading from sql_database sources. Note that you may need to install additional SQLAlchemy dialects for your source database.
Expected behavior
The generated requirements.txt should be modified to contain the dependency dlt[sql_database].
At present, this is the requirements.txt generated:
dlt version
0.9.9a0
Describe the problem
The general flow for the SQL Database source in versions <0.5.4 has been:
pip install dlt[duckdb]
dlt init sql_database duckdb
pip install -r requirements.txt
python sql_database_pipeline.py
But in version 0.9.9a0, this flow is broken due to missing dependency
dlt[sql_database]
. The same flow now gives the following error:Expected behavior
The generated
requirements.txt
should be modified to contain the dependencydlt[sql_database]
.At present, this is the
requirements.txt
generated:Expected:
Steps to reproduce
pip install dlt[duckdb]
dlt init sql_database duckdb
pip install -r requirements.txt
python sql_database_pipeline.py
Operating system
Windows
Runtime environment
Local
Python version
3.11
dlt data source
SQL Database
dlt destination
DuckDB
Other deployment details
No response
Additional information
No response