search

NVlabs / timeloop

Timeloop performs modeling, mapping and code-generation for tensor algebra workloads on various accelerator architectures.
https://timeloop.csail.mit.edu/
BSD 3-Clause "New" or "Revised" License
303 stars 99 forks source link

Preload weight values #236

Closed RaphaelKlink closed 5 months ago

RaphaelKlink commented 5 months ago

Hey,

is there an option to define the preloading of values to certain memory levels e.g. weights are often reused and therefore already loaded into the scratchpad.

Greetings Raphael Klink

angshuman-parashar commented 5 months ago

Yes. Add a constraint to bypass Weights at all levels outside of the scratchpad where it's resident.