search

NLeSC / xtas

Distributed text analysis suite based on Celery
http://nlesc.github.io/xtas/
Other
94 stars 32 forks source link

Notes on _emotion.py #103

Open LourensVeen opened 8 years ago

LourensVeen commented 8 years ago

Only one here: this file is a rather messy with the initialization interleaved with functions. Could we wrap everything into functions and then just have a single call to an init function at the top scope? And rename X_train and Y_train x_train and y_train?

larsmans commented 8 years ago

We should probably be using functions decorated as Celery signals. I tried that with the SentiWords tagger and the worker_process_init signal, but the problem with that is that it has a fixed 4s timeout and many tasks take much more than 4s to initialize.