search

gchq / stroom

Stroom is a highly scalable data storage, processing and analysis platform.
https://gchq.github.io/stroom-docs/
Apache License 2.0
425 stars 56 forks source link

Ref load staging db serialises typeId as an int not a byte #4318

Open at055612 opened 2 weeks ago

at055612 commented 2 weeks ago

It should serialise the typeId as a byte to save on 3 bytes per value. This ought to make the staging db smaller and the load fractionally faster.

see stroom.pipeline.refdata.store.StagingValue

The staging envs are transient so there is no issue in changing the serialisation here.