railwayapp / templates

Railway starters
https://railway.app
MIT License
330 stars 150 forks source link

Add Dagster Template #437

Open ndneighbor opened 11 months ago

ndneighbor commented 11 months ago

Goal

Dagster is an analytics template for building robust data applications with a focus on data quality and reliability.

Payout

$250

Expectation

Develop the Dagster template to support data pipelines, data testing, and data monitoring. It should enable users to build data applications with confidence. Consider incorporating features like data partitioning and metadata management. Comprehensive documentation will guide users in leveraging Dagster for building scalable and reliable data analytics solutions.

CharlesFr commented 2 months ago

This would be great but is it possible? As far as I understand Dasgter requires shared access to a local file path DAGSTER_HOME (for both dagster-webserver and dagster-daemon) and railway limits access to volumes to only the attached service.