While you can modify the soft limit of open files, it might be best for me to add a semaphore for open files or something. I've ran into this issue when running the GIS scrapper in console like this:
Thankfully since I made it service already, adding a semaphore shouldn't be too difficult, it'll be more a matter of making sure it's properly passed to the different instances of the classes using it.
While you can modify the soft limit of open files, it might be best for me to add a semaphore for open files or something. I've ran into this issue when running the GIS scrapper in console like this:
You can view the source here.
https://github.com/AKST/Australian-Address-Boundaries-Land-Property-Price-Database/blob/142bea0e2df25362bd6c7ad20871f4c3917682f0/lib/tasks/gis_scrapper.py#L90-L99
Thankfully since I made it service already, adding a semaphore shouldn't be too difficult, it'll be more a matter of making sure it's properly passed to the different instances of the classes using it.
https://github.com/AKST/Australian-Address-Boundaries-Land-Property-Price-Database/blob/142bea0e2df25362bd6c7ad20871f4c3917682f0/lib/service/io.py#L6-L23
Note
This isn't an issue when you run this in iPython