nestauk / dap_dv_backends

MIT License
0 stars 0 forks source link

Change request type to send arrays of text #190

Closed doogyb closed 1 year ago

doogyb commented 2 years ago

This PR changes the type of annotation request a spotlight worker node recieves. Instead, the worker will recieve an array of text, which means that the node itself will need to host not only a spotlight container, but also a small server capable of handling the logic needed for these requests. As a result, the worker nodes have much less network overhead, and they're processing much larger chunks of data.

closes #189