pydiverse / pydiverse.pipedag

A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
https://pydiversepipedag.readthedocs.io/
BSD 3-Clause "New" or "Revised" License
15 stars 2 forks source link

consider creating a utils library in pydiverse #79

Open windiana42 opened 1 year ago

windiana42 commented 1 year ago

There is generic functionality needed by several pydiverse libraries such as:

  1. initializing structlog
  2. failing unit tests on logger.error
  3. shared code: deep_merge
windiana42 commented 1 year ago

see https://github.com/Quantco/QClogger for ideas on logger.error failing

windiana42 commented 1 year ago

see #53