During celery worker startup there are KcidbSubmit objects created for each worker.
When a celery task that needs to push data to KCIDB is run a kcidb-submit process is spawned by the KcidbSubmit object.
These processes live until owning celery worker is terminated.
Tasks that communicate with kcidb stream data to the appropriate kcidb-submit process stdin through a pipe.
mgalka
commented
3 years ago
During celery worker startup there are KcidbSubmit objects created for each worker. When a celery task that needs to push data to KCIDB is run a kcidb-submit process is spawned by the KcidbSubmit object. These processes live until owning celery worker is terminated. Tasks that communicate with kcidb stream data to the appropriate kcidb-submit process stdin through a pipe.