search

coiled / etl-tpch

BSD 3-Clause "New" or "Revised" License
9 stars 1 forks source link

Local Prefect #3

Open mrocklin opened 4 months ago

mrocklin commented 4 months ago

If we support a local mode I wonder if we could handle Prefect locally without Prefect Cloud.

According to https://docs.prefect.io/latest/tutorial/ it could be that we just need to do the following:

$ prefect server start

Configure Prefect to communicate with the server with:

    prefect config set PREFECT_API_URL=http://127.0.0.1:4200/api

I just tried this with generate_data.py and while the runs failed, I think that the prefect stuff was fine.

mrocklin commented 4 months ago

Oh, I'm getting these now:

sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked