daphne-eu / daphne

DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines
Apache License 2.0
67 stars 62 forks source link

Matrix Result Property Recording and Insertion in IR #854

Open StoeckOverflow opened 1 month ago

StoeckOverflow commented 1 month ago

To advance research focused on the reuse of exact property knowledge for recompilation, we require a feature that records runtime properties of matrix results and reuses them in subsequent program runs. This will allow for better optimizations and facilitate deeper insights into matrix operations during the compilation process.

The task is to introduce two new passes:

  1. Property Recording Pass: This pass will capture and record runtime properties of matrix result objects (e.g., sparsity) and save them in a JSON file for later use.
  2. Property Insertion Pass: This pass will retrieve the previously recorded properties from the JSON file and reinsert them into the Intermediate Representation (IR) during recompilation, enabling reuse of these properties to optimize subsequent executions.