Closed yuwenchen95 closed 11 months ago
dot
products are slow on GPU because it contains a "reduction" which means that even if we split the computation of the dot products at the end we need to synchronize all threads / cores to sum the components of the dot products.
mul!
is the most expensive operation on GPU only if you have a very large problem (n=10000 if dense or n=100000 if sparse).
Note you can also test car
and minares
. They are new methods dedicated to symmetric (positive definite) systems.
When I try to solve different positive definite linear system using different methods,
I found lots of time are spent on some dot operations (specifically to the computation of
α
in each solver), which is counterintuitive to me since a CPU version spends most of computation time onmul!
operations and the dot product time is negligible. Is this the difference between running indirect methods on CPUs and GPUs or it is potentially a bug?