search

pkt / splitta

Automatically exported from code.google.com/p/splitta
0 stars 0 forks source link

Loading model data can be vastly sped up #1

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
Instead of using the very slow python .gz implementation try

def load_pickle(path):
    #i = gzip.open(path, 'rb')
    i = os.popen("zcat " + path)
    data = cPickle.load(i)
    i.close()
    return data

Thanks for coding this though, the results are way better than previously 
existing system. I'm using Splitta to code a couple of projects aimed at 
writers and the accuracy has made a lot features things feasible.

Original issue reported on code.google.com by mkbun...@gmail.com on 26 Feb 2010 at 6:46

GoogleCodeExporter commented 9 years ago 
Yeah, you're right. I committed this change, thankyou.

Original comment by dgill...@gmail.com on 12 Aug 2010 at 6:24

GoogleCodeExporter commented 9 years ago

Original comment by dgill...@gmail.com on 12 May 2011 at 10:03