Open gitbuda opened 3 months ago
any update? look like cugraph.pagerank still results different output compared with pagerank cpu version
@nad010286 nothing yet, just didn't have a chance to finish this work, but it's still on the short-term TODO list 😄
Hi @nad010286! I've made some progress on a small scale. Seems like the regular CPU pagerank and cugraph pagerank are producing the same outputs (CPU test case vs cugraph test case) 🤔
Can you please provide a test case from your side (something reasonable in size, max 100k nodes + edges), in the e2e
test format 🙏:
.cyp
format (it's actually cypher per line, it can be many lines, but it's important to not break down single query into multiple lines) GRAPH INPUT EXAMPLE.yml
format (make sure you have everything, the exact query, and exact outputs) TEST CASE EXAMPLEHi @nad010286! I've made some progress on a small scale. Seems like the regular CPU pagerank and cugraph pagerank are producing the same outputs (CPU test case vs cugraph test case) 🤔
Can you please provide a test case from your side (something reasonable in size, max 100k nodes + edges), in the
e2e
test format 🙏:
- The graph should be in the
.cyp
format (it's actually cypher per line, it can be many lines, but it's important to not break down single query into multiple lines) GRAPH INPUT EXAMPLE- The test case should be in the
.yml
format (make sure you have everything, the exact query, and exact outputs) TEST CASE EXAMPLE
hey, Im having issue to build the cuGraph and MAGE from source :( any instructions or things I have to pay attention to? Or if you can send me the docker image that you already built, Im happy to perform some tests for you with loads of graph data
Hi @nad010286! I've made some progress on a small scale. Seems like the regular CPU pagerank and cugraph pagerank are producing the same outputs (CPU test case vs cugraph test case) 🤔 Can you please provide a test case from your side (something reasonable in size, max 100k nodes + edges), in the
e2e
test format 🙏:
- The graph should be in the
.cyp
format (it's actually cypher per line, it can be many lines, but it's important to not break down single query into multiple lines) GRAPH INPUT EXAMPLE- The test case should be in the
.yml
format (make sure you have everything, the exact query, and exact outputs) TEST CASE EXAMPLEhey, Im having issue to build the cuGraph and MAGE from source :( any instructions or things I have to pay attention to? Or if you can send me the docker image that you already built, Im happy to perform some tests for you with loads of graph data
I would also be very interested in an updated guide on how to build cugraph mage - I tried building the main branch with CUDA 11.8 but the nvcc compiler does not support C++ 20, so it fails with unorder_map::contains later on.
managed to build and run some tests @gitbuda The results are similar with very small difference. But processing time is worse than CPU. Not sure if GPU is used because by monitoring the GPU via nvidia-smi, I can only see power consumption increase after the result is out. Also no VRAM is used.
laiden
andbetweenness_centrality
systemctl restart docker
; rundocker run -it --rm --gpus all ubuntu nvidia-smi
to verify (source)mage/setup
to pick individual libraries to install -> add that as a docker argument because usually, someone needs a specific binary (while the whole think doesn't compile); consider addinginit
bash script because usually, installation of deps fails (e.g.gdl
is a very complex dependency)Docker Build Commands
Docker Base Images
Done
python3 /mage/setup build --gpu --cpp-build-flags MAGE_CUGRAPH_ROOT=/opt/conda CMAKE_C_COMPILER=gcc CMAKE_CXX_COMPILER=g++ -p /usr/lib/memgraph/query_modules
fmt
(when all is compiled), again issues with fmt+spdlog, spdlog from/opt/conda
is not ok (maybe interesting https://github.com/gabime/spdlog/issues/2825); fmt v9 doesn't compile with used g++, fmt v10 doesn't work with the spdlog in the/opt/conda
cugraph/algorithms.hpp
for some reason doesn't work -> make sure GPU+Docker is oklibcugraph-ops++.so
andlibraft.so
-> taken fromrapidsai/base
Docker image under/opt/conda/lib
cugraph.pagerank
to work correctly, implement the package process and release Docker image only withmemgraph
andpagerank
internallyExperiment / Optional
Description
Please briefly explain the changes you made here.
Pull request type
Related issues
Delete if this PR doesn't resolve any issues. Link the issue if it does.
######################################
Reviewer checklist (the reviewer checks this part)
Module/Algorithm
Documentation checklist