speed up manage.parse()

[epogrebnyak]

manage.parse seems to run slower than its components, if correctly measured

• [x] why running time for parse(2018, 1) is 4 times greater than sum of its components isolation1() and isolation2?
• [ ] how can one make parse() run faster?

Must use dev-slim branch for this task.

https://github.com/mini-kep/parser-rosstat-kep/blob/00440ec8bed7634e0a8bf20cbf867a8b789fffc8/src/manage.py#L214-L234

[epogrebnyak]

Current specific question is making dispatch.evaluate() run faster.

https://github.com/mini-kep/parser-rosstat-kep/blob/3155bad6b58aab886ee74b22dc9c2e6a919f5660/src/timer.py#L33-L35

[epogrebnyak]

Possible ways to go further:

• mutlithreads/processes
• numpy arrays

[epogrebnyak]

def multithreading(func, args, 
                   workers):
    with ThreadPoolExecutor(workers) as ex:
        res = ex.map(func, args)
    return list(res)

def multiprocessing(func, args, 
                    workers):
    with ProcessPoolExecutor(work) as ex:
        res = ex.map(func, args)
    return list(res)