trying to run in CPU by commenting out cuda_set_device(0); and adding gpu_index = -1;to the top of the init. it works and appears to use CPU. however, if you do this and don't happen to have CUDA installed, their will be a linker error (can't find cublas, cudart, etc) so it won't work on non-CUDA machines. i think these are baked into the dylib. we could refactor the code or perhaps just build a separate CPU-only dylib.
trying to run in CPU by commenting out
cuda_set_device(0);and addinggpu_index = -1;to the top of the init. it works and appears to use CPU. however, if you do this and don't happen to have CUDA installed, their will be a linker error (can't find cublas, cudart, etc) so it won't work on non-CUDA machines. i think these are baked into the dylib. we could refactor the code or perhaps just build a separate CPU-only dylib.