[3.0] Read all metadata in one read

coreweave / tensorizer

Module, Model, and Tensor Serialization/Deserialization

MIT License

180 stars 25 forks source link

[3.0] Read all metadata in one read #148

Open bchess opened 3 months ago

bchess commented 3 months ago

Eta0 last week • We should probably read the entire metadata section, including these headers, in one or two read (or readv) operations and just use the _TensorHeaderDeserializer buffer constructor instead of from_io.