search

ptwobrussell / Mining-the-Social-Web

The official online compendium for Mining the Social Web (O'Reilly, 2011)
http://bit.ly/135dHfs
Other
1.21k stars 491 forks source link

Better memory managment #24

Closed sammyrulez closed 12 years ago

sammyrulez commented 12 years ago

I had to do these changes in order to make the script work on a 32bit system and avoid Memory Errors. It's a bit more pythonic ( using generator instead of loadin a huge list and later dump it to stdout)

ptwobrussell commented 12 years ago

The CouchDB commit looks good. Haven't tested it myself, but read through it. It's a nice and elegant solution. Wish I'd have thought of it myself :)

I can't merge in the mongodb commit to my master at this point since the book doesn't use it elsewhere, but definitely appreciate you passing it along.