get rid of base64 encoding for raw

certtools / intelmq

IntelMQ is a solution for IT security teams for collecting and processing security feeds using a message queuing protocol.

https://docs.intelmq.org/latest/

GNU Affero General Public License v3.0

974 stars 295 forks source link

get rid of base64 encoding for raw #1101

Open ghost opened 7 years ago

ghost commented 7 years ago

[ ] could there be any problems with redis?
[ ] do other messaging queues support binary data too?
[ ] check if there are any problems when removing it in production?
[ ] how much size do we save when we remove it?

navtej commented 7 years ago

Would it make sense to keep raw as b64 gzipped? It is probably batter than totally removing as of now. Mainly large sized raw is seen from collector to parser.

ghost commented 7 years ago

Would it make sense to keep raw as b64 gzipped?

Why base64 if we then gzip anyway?

It is probably batter than totally removing as of now.

Why?