search

themoeway / yomichan-data-exporter

Just a quick and hacky way to export all of dictionaries from yomichan installations for importing in newer forks.
9 stars 2 forks source link

Suggestion: Support Protocol Buffers #5

Open execute-ord66 opened 1 month ago

execute-ord66 commented 1 month ago

Protocol Buffers are a language-neutral, platform-neutral, extensible way of serializing structured data for use in communications protocols, data storage, and more, originally designed at Google (see). Transitioning dictionary data files from JSON to Protocol Buffers could enhance data handling and processing speed for both import and export tasks.

jamesmaa commented 1 month ago

I don't think protobuf solves the current performance bottleneck that yomitan is experiencing. From our understanding the main performance bottleneck is IndexedDb slowness. I don't think that can be easily solved with protobuf.

That said, I'm willing to be convinced if you can create a prototype that uses protobuf and compare the performance characteristics of each serde