[3/N][zero serialization] Make Encoder produce and pass chunks in desired format

[jianoaix]

Why are these changes needed?

This plumbs the chunk encoding format from Encoder, and make it produce and pass chunks in that desired format.

Checks

• [x] I've made sure the lint is passing in this PR.
• [x] I've made sure the tests are passing. Note that there might be a few flaky tests, in that case, please comment that they are not relevant.
• Testing Strategy
  • [ ] Unit tests
  • [ ] Integration tests
  • [ ] This PR is not tested :(