Closed jamesaoverton closed 7 years ago
Do we want to keep the full dir & the zipped dir, or delete the full dir when we're done compressing?
Good question. I'm not sure. What do you think?
I think it would make sense to delete the full dir, otherwise why compress it at all? Especially if we wanted to run this over a list of IRIs to fetch.
Since OWL XML files are verbose, we should compress them on disk. See
spit-gzipped!
andslurp-gzipped!
in https://github.com/knocean/knode/blob/master/src/knode/upstream.clj