Use Worker API to move the JS processing of bigquery results off the main thread. We were encountering problems with the mainthread being blocked and heartbeat requests not being answered. This was leading to k8s killing the pod.
Unfortunately, the use of workers + typescript is kind of a WIP, so to get this working I updated the node options to use the ts loader. This probably should be cleaned up in future..
Use
Worker
API to move the JS processing of bigquery results off the main thread. We were encountering problems with the mainthread being blocked and heartbeat requests not being answered. This was leading to k8s killing the pod.Unfortunately, the use of workers + typescript is kind of a WIP, so to get this working I updated the node options to use the ts loader. This probably should be cleaned up in future..