search

BBN-Q / QGL.jl

A performance orientated QGL compiler.
Apache License 2.0
12 stars 5 forks source link

Parallel compilation #26

Open gribeill opened 7 years ago

gribeill commented 7 years ago

Work out a strategy for parallel compilation of sequence lists.

dieris commented 7 years ago

Check out this notebook, based on the parallel 1-q compilation by @matthewware

gribeill commented 7 years ago

I meant actual parallelism in the compiler, not just when compiling multiple files... I think this is doable, but it's major surgery so nothing urgent...

matthewware commented 7 years ago

The one option I can think of without major surgery is a total hack. Namely just split the sequences into N chucks on the front end, compile with N threads and manually stitch the compiled sequences .h5 file back together on the back end. I have faith we can engineer a more elegant solution.

matthewware commented 7 years ago

At any rate, it's a stretch goal for down the road as sequences get more complicated.

dieris commented 7 years ago

Oh, now I see what you mean. I guess I stopped reading at the title 🙈