search

concept-inversion / C-SAW

A Framework for Graph Sampling and Random Walk on GPUs.
38 stars 8 forks source link

A question about out of memory sampling #1

Closed soodoshll closed 4 years ago

soodoshll commented 4 years ago

Hi, I have one question about out of memory sampling. When we do layer-wise sampling, we need the information of the whole frontier. How it is implemented in C-SAW? Thank you!

concept-inversion commented 4 years ago

Hi Qidong Su. Thank you for your interest in C-SAW. Yes. The frontier queue can be in different depths and the sampling for the previous layer should be completed for sampling the next layer. The current C-SAW implementation does not support layer-wise sampling for out of memory sampling as naive implementation of layer-sampling would be inefficient. I am working on efficient implementation of layer sampling for out of memory.

On Tue, Jul 21, 2020 at 4:06 AM Qidong Su notifications@github.com wrote:

Hi, I have one question about out of memory sampling when reading your paper. It seems that the vertices in the frontier queue can be in different depths, that is, before one layer of sampling is finished it starts the next layer, and the frontier of the former step is incomplete. When we do layer-wise sampling, we need the information of the whole frontier. How it is implemented in C-SAW? Thank you!

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/concept-inversion/C-SAW/issues/1, or unsubscribe https://github.com/notifications/unsubscribe-auth/AE5O75VW67FMTNETMIQ7NSLR4VEBTANCNFSM4PDJGYSA .

soodoshll commented 4 years ago

Thank you for your reply!