HTTPArchive / data-pipeline

The new HTTP Archive data pipeline built entirely on GCP
Apache License 2.0
5 stars 0 forks source link

Subscription for "releases" at the end of a pipeline run #129

Open giancarloaf opened 2 years ago

giancarloaf commented 2 years ago

We would like to create an alerting/subscription mechanism for HTTPArchive users/analysts to be notified when a pipeline run has been completed and tables have been generated.

giancarloaf commented 2 years ago

@rviscomi had some ideas here along the lines of asking in slack about options folks care about

  1. email
  2. tweet
  3. slack message
  4. GCS bucket
  5. GitHub data-pipeline updates (with webhooks?)
max-ostapenko commented 2 months ago

I think of the following channels:

  1. internal community - #http-archive Slack channel,
  2. external promo - @twitter,
  3. trigger downstream consumers - PubSub topic.