cosmicBboy / ml-research

Research projects in Machine Learning
MIT License
6 stars 2 forks source link

[metalearn] create daemon-compatible pipeline fit limit enforcer #14

Closed cosmicBboy closed 5 years ago

cosmicBboy commented 5 years ago

Currently using pynisher to place runtime and memory limits when fitting an sklearn pipeline.

Create a library function that performs this task. See SO post for hint

cosmicBboy commented 5 years ago

Execution

https://stackoverflow.com/a/8963618

cosmicBboy commented 5 years ago

might want to use threads instead of processes:

http://code.activestate.com/recipes/483752-timelimit-tell-a-function-to-time-out-after-a-time/

cosmicBboy commented 5 years ago

this issue is now invalid. solved the issue with this PR to kiosk: https://github.com/cosmicBboy/kiosk-ml/commit/bcac9c49c6b36159cb689bd7d9e7cc3183d8f9ff