ToMemoryConfig ops should not be placed on the input activations, weight, or bias of the conv2d op as the conv2d op transforms these tensors on host and then moves them to device on its own (hack here)
Typecast on the output ToMemoryConfig doesn't work on host (hack here)
Changes:
TTForge PR: https://github.com/tenstorrent/tt-forge-fe/pull/168