We should switch to the MessagePack encoding for communications between the manager and agents.
This will allow greater flexibility and remove the need to JSON-encode data with arbitrary structure, as well as improve performance when handling binary data.
The main downside of MessagePack is the lack of schema enforcement, but this shouldn't be much of a problem. Perhaps we can substitute Pydantic models for schema validation.
We should switch to the MessagePack encoding for communications between the manager and agents.
This will allow greater flexibility and remove the need to JSON-encode data with arbitrary structure, as well as improve performance when handling binary data.
The main downside of MessagePack is the lack of schema enforcement, but this shouldn't be much of a problem. Perhaps we can substitute Pydantic models for schema validation.