MattTriano / analytics_data_where_house

An analytics engineering sandbox focusing on real estates prices in Cook County, IL
https://docs.analytics-data-where-house.dev/
GNU Affero General Public License v3.0
9 stars 0 forks source link

Modify system to work when run by Docker in rootless mode #192

Open MattTriano opened 12 months ago

MattTriano commented 12 months ago

I've wanted to experiment with running docker in rootless mode for a while, and I recently built a new server to run larger experiments that presents a perfect platform to play with this mode.

One of the main issues will be in running the jupyter lab server used for developing suites of expectations, but hopefully I can resolve these problems by assuming the airflow user role before creating all locations needed by jupyter.

I'll also have to make sure airflow services run as the airflow user or otherwise get suitable UID/GID values.

I'm sure I'll find more issues; I should figure out a good way to test out fresh builds.

I'm not sure if this will be feasible; airflow may require GID=0. But I want to see if I can work around it.