ELVIS-Project / vis-framework

Thoroughly modern symbolic musical data analysis suite.
http://elvisproject.ca/
31 stars 6 forks source link

Multiprocess new_ngram indexer column calculations? #417

Open alexandermorgan opened 7 years ago

alexandermorgan commented 7 years ago

Multiprocessing and the series_indexer were slated for removal in VIS 3 but it may be possible to multiprocess the new_ngram indexer's column calculations (each of which corresponds to an entire dataframe of the old ngram indexer). In theory this should be relatively easy but this is something that can wait until VIS 3.1 as it's not a major change. The new_ngram indexer is already relatively fast but it can never be too efficient because soon we'll start using it as an intermediary tool to help with complex things like dissonance detection.