PaRSEC is a generic framework for architecture aware scheduling and management of micro-tasks on distributed, GPU accelerated, many-core heterogeneous architectures. PaRSEC assigns computation threads to the cores, GPU accelerators, overlaps communications and computations and uses a dynamic, fully-distributed scheduler based on architectural features such as NUMA nodes and algorithmic features such as data reuse.
Other
50
stars
17
forks
source link
Mandatory Data flush needs to be phased out from DTD #159
Flushing all data is necessary in a DTD program. This makes DTD inflexible in cases of composing multiple DTD kernels. Flushing the data enforces all the data to go back to the initial data distribution in a distributed run and introduces additional dependencies and in a unfavorable case more data transfer.
Why do we have this data_flushes?
In DTD the data_flush has two meaning. It indicates the last usage of data and instructs the engine to transport the data back to the original owner(owner according to initial data-distribution). This helps us reuse memory buffer and in turn achieve better performance.
How to phase it out:
We need to additional structures in the DTD system to have a more intelligent management of data. The first being a Cache and the second being a LRU. Everytime we get a remote data we will push it in a cache indexed by the data_key and the version. When we flush the data, the data will be cached in the LRU and based on some threshold will be reused as we need memory buffer for incoming data. If we have some data lingering in the LRU they will be cleaned when we destroy the data completely.
abouteiller
commented
6 years ago
Original report by Reazul Hoque (Bitbucket: rhoque_icl, ).
Flushing all data is necessary in a DTD program. This makes DTD inflexible in cases of composing multiple DTD kernels. Flushing the data enforces all the data to go back to the initial data distribution in a distributed run and introduces additional dependencies and in a unfavorable case more data transfer.
Why do we have this data_flushes? In DTD the data_flush has two meaning. It indicates the last usage of data and instructs the engine to transport the data back to the original owner(owner according to initial data-distribution). This helps us reuse memory buffer and in turn achieve better performance.
How to phase it out: We need to additional structures in the DTD system to have a more intelligent management of data. The first being a Cache and the second being a LRU. Everytime we get a remote data we will push it in a cache indexed by the data_key and the version. When we flush the data, the data will be cached in the LRU and based on some threshold will be reused as we need memory buffer for incoming data. If we have some data lingering in the LRU they will be cleaned when we destroy the data completely.