ApolloResearch / rib

Library for methods related to the Local Interaction Basis (LIB)
MIT License
2 stars 0 forks source link

Take cache mode activations off the GPU #355

Closed stefan-apollo closed 6 months ago

stefan-apollo commented 7 months ago

Take cache mode activations off the GPU

Description

In _append_to_hooked_list (which is used only by analysis hooks) we now move the data to CPU to save VRAM.

Related Issue

Fixes #278

How Has This Been Tested?

Using this hook in feature viz code worked fine.

Does this PR introduce a breaking change?

No.