Optimize overall flow - Githubissues

jakipatryk / spark-persistent-homology

(WIP, not fast enough for any production usage yet) Library for persistent homology computations in Apache Spark.

Apache License 2.0

0 stars 0 forks source link

Optimize overall flow #11

Closed jakipatryk closed 1 year ago

jakipatryk commented 1 year ago

Individual components are probably already OK (except Vietoris-Rips filtration generation), but full flow (points cloud -> persistence image) is really slow. Before 1.0.0 release it must be improved significantly.

To do:

[x] Find weak points of the flow
[x] Optimize Vietoris-Rips
[x] Optimize E2E flow

jakipatryk commented 1 year ago

I already did everything I can to optimise the current design but it still is too slow. Library needs to be redesigned to compute cohomology instead, which should significantly improve E2E performence. Will be done in epic https://github.com/jakipatryk/spark-persistent-homology/issues/38.