sjdv1982 / seamless

Seamless is a framework to set up reproducible computations (and visualizations) that respond to changes in cells. Cells contain the input data as well as the source code of the computations, and all cells can be edited interactively.
http://sjdv1982.github.io/seamless
Other
20 stars 6 forks source link

"Nesting" metadata flag #241

Open sjdv1982 opened 9 months ago

sjdv1982 commented 9 months ago

Annotate transformations that invoke other transformers as "nesting" in the transformation metadata in the Seamless database.

The main use case is to identify all buffers and database entries that are needed to describe an entire computation result, in order to share it with others. In that case, a buffer read server and a database server must be opened in special "recording" mode, keeping track of all requested checksums and database entries, copying the latter into a target database. Seamless must also be put in "recording" mode, in the sense that nesting transformations (or elided macros) are recorded but are then still re-executed in order to retrieve the nested jobs (hard case: nesting transformations (or macros) that need an environment!).