RK with averaging is a thing we should do. Use the given sampling strategy to sample several rows at each iteration. Average the updated iterates corresponding to each row. Let's use a weighted average with fixed weights for each row to start with, uniform by default.
Description
RK with averaging is a thing we should do. Use the given sampling strategy to sample several rows at each iteration. Average the updated iterates corresponding to each row. Let's use a weighted average with fixed weights for each row to start with, uniform by default.