search

NOAA-GSL / VxIngest

Other
2 stars 0 forks source link

We need to model a process for using a task queue to make cloud ingest processing more scalable #296

Open randytpierce opened 8 months ago

randytpierce commented 8 months ago

Describe what We need to model a process for using a task queue to make cloud ingest processing more scalable. Currently the ingest processes are designed for a cron driven set of tasks. This will not scale in a cloud environment. We need to evaluate and model a different process for queing up ingest templates or possibly even subdividing certain ingest templates into succinct tasks that can be performed in a container.

randytpierce commented 5 months ago

still needed, not stale

github-actions[bot] commented 2 months ago

This issue is stale because it has been open 90 days with no activity.