search

fverdugo / XM_40017

Jupyter notebook scripts for the course Programming Large-Scale Parallel Systems (XM_40017) at Vrije Universiteit Amsterdam.
Creative Commons Attribution 4.0 International
38 stars 10 forks source link

Some of my thoughts on Latency hiding #29

Closed ezrannetttty closed 11 months ago

ezrannetttty commented 11 months ago

https://github.com/fverdugo/XM_40017/blob/26afa1d3c71e169189620f7435bd02b66b8f4499/notebooks/jacobi_method.ipynb#L641

May I ask if what you are trying to convey is in fact: "we are hiding communication latency by overlapping it with computation that we need to do anyway"?

fverdugo commented 11 months ago

Dear @ezrannetttty,

yes, this is indeed a typo.

with communication that we need to do anyway -> with computation that we need to do anyway.

Feel free to open a PR.

ezrannetttty commented 11 months ago

Dear @fverdugo,

The new PR has been submitted. It feels great to contribute.

BTW, the teaching materials you've written are of very high quality and have been extremely helpful for me in understanding parallel computing.