search

niklasb / dryscrape

[not actively maintained] A lightweight Python library that uses Webkit to enable easy scraping of dynamic, Javascript-heavy web pages
http://dryscrape.readthedocs.io/
MIT License
533 stars 67 forks source link

Lot of Xvfb processes after using start_xvfb() #52

Closed siddarth3110 closed 8 years ago

siddarth3110 commented 8 years ago

I am scraping lot of pages using multi processing. if I use dryscrape.start_xvfb() before initialing the session then I am let with lot of Xvfb processes which consume a significant chunk of ram. Is there a way to close/reuse xvfb?

RegExrTech commented 6 years ago

I'm having the same issue, did you solve this problem?