search

singer-io / target-stitch

A Singer.io Target for the Stitch Import API
GNU Affero General Public License v3.0
26 stars 31 forks source link

psutil.NoSuchProcess error caused by MemoryReporter class on certain types of distributed environments #58

Open chrisgoddard opened 5 years ago

chrisgoddard commented 5 years ago

I'm running tap-braintree with target-stitch on PythonAnywhere.com which is a simple Python hosting platform (with a simple bash command scheduler) built on AWS EC2.

Apparently because they operate on a shared environment with a large cluster, normal Linux process management doesn't really work.

Maybe a command line option to disable memory reporting would be helpful if anyone runs into this? It might be too much of a fringe case to worry about - although other than this issue, PythonAnywhere is actually a great environment for running singer because you can schedule bash commands daily or hourly.

If anyone else runs into this issue, I created a fork here with the extremely inelegant solution of commenting out the MemoryReporter.start() line. You can install pip install git+https://github.com/chrisgoddard/target-stitch

KAllan357 commented 5 years ago

I think a command-line option would work well here.