admiralbolt / sms

Seattle Music Scene
1 stars 0 forks source link

Janitor setup #80

Closed admiralbolt closed 3 months ago

admiralbolt commented 4 months ago

The Janitor will be the last of the 3 major components for the ingestion pipeline.

The Janitor will be responsible for cleaning data after it's created, which will include things like:

  1. Deduplicating events.
  2. Adding artists to events from apis that don't have them.
  3. (Maybe) Automatically merging venues + artists.