For some of the larger data sets, the 2GB cap on /tmp is too small.
We're now writing downloads to ./downloads and then wiping the files
when done.
I also wrote up my own Socrata client library. ExSoda, while nice, is
just too damned restrictive. I don't like having to convert formats and
I don't like not having control of the request/response cycle to the
API.
For some of the larger data sets, the 2GB cap on /tmp is too small. We're now writing downloads to
./downloadsand then wiping the files when done.I also wrote up my own Socrata client library. ExSoda, while nice, is just too damned restrictive. I don't like having to convert formats and I don't like not having control of the request/response cycle to the API.