Mod: Large messages are corrupted when printing to console

[aSemy]

While I can try and make all messages sent from the Factorio mod small, some are just too large. This leads to the messages being split by another log message when they're printed to console.

Options:

• Just make sure all packets are small? What's small enough?
• Use script.encode_string(...) to deflate packets? It looks like this is zlib encoding, which should be good
• Split up strings into multipart messages if they're too large
• Split up large arrays into multiple messages.

Other serialization and encoding libraries that might help:

• https://github.com/starwing/lua-protobuf

• https://github.com/grafi-tt/lunajson

• http://lua-users.org/wiki/CompressionAndArchiving

• https://luapower.com/zlib

• https://github.com/appgurueu/modlib#bluon

• https://github.com/dingyi222666/lua-table-serialize

• https://github.com/uriid1/lua-serialize

• https://github.com/rxi/lume#lumeserializex

• https://github.com/SwadicalRag/bON

• https://jbrandhorst.com/post/go-protobuf-tips/

• https://github.com/bakpakin/binser

• flatbuffers https://github.com/dvidelabs/flatcc

• z85 encoding

  • Kotlin https://gist.github.com/ischumacher/b4929f26341ebef62cbce35c65543eda
  • Lua https://web-eworks.github.io/lZ85/

• https://github.com/SafeteeWoW/LibDeflate

• CBOR

  • https://www.zash.se/lua-cbor.html
  • https://code.zash.se/lua-cbor/archive/68b3a36d0816.tar.gz

• BSON

  • https://github.com/mpaland/bsonfy
  • https://github.com/tcoram/bson-lua

• bebop https://rainway.com/blog/2020/12/09/bebop-an-efficient-schema-based-binary-serialization-format/

• binser

  • https://github.com/bakpakin/binser
  • https://github.com/maxiy01/tstl-binser

[aSemy]

all messages are now encoded using encode_string(), and decoded in the server. This works really well! I've not noticed any more corrupted messages.