april-tools / cirkit

a python framework to build, learn and reason about probabilistic circuits and tensor networks
https://cirkit-docs.readthedocs.io/en/latest/
GNU General Public License v3.0
71 stars 1 forks source link

`pyjuice` benchmark #15

Closed lkct closed 1 year ago

lkct commented 1 year ago

Closes #2

Add benchmark scripts for pyjuice. Include settings for both torch.compile enabled and disabled. Currently, only HCLT is benchmarked with different latent sizes.

The "compile" time currently measures the first pass. The time for building the circuit is not yet measured as structure learning is coupled in the same procedure. NEED to decide how we design this.

Another thing TODO is to double-check memory consumption for appropriate garbage collection.

Also, the global compilation does not work now as there're complicated backward procedures and hooks. (Assuming NO solution for this.)