GaloisInc / haskell-tor

A Haskell implementation of the Tor protocol.
BSD 3-Clause "New" or "Revised" License
272 stars 19 forks source link

Incremental download / decompress / parse chain #18

Open acw opened 8 years ago

acw commented 8 years ago

This bug may require changes to the pure-zlib library, hence the "medium."

Right now, I believe there's still a memory spike every time the node downloads a consensus or directory document from a server, because it downloads the whole file, decompresses it, and then parses it. It would be very handy if we could instead pull down a chunk, and feed it through all three bits at the same time.