rapidsai / node

GPU-accelerated data science and visualization in node
https://rapidsai.github.io/node/
Apache License 2.0
187 stars 20 forks source link

Sigma.js demo using node-rapids #392

Closed thomcom closed 2 years ago

thomcom commented 2 years ago

This PR introduces a api-server demo component that provides data for the extra-large-graphs demo at https://github.com/jacomyal/sigma.js/pull/1252. Now that this is fresh and ready, I'll be cleaning up that PR for final submission starting next week.

Fastify HTTP Server Demo

This project is a Fastify-based node http server that allows commands and data to be sent to and from the NVIDIA GPUs installed on the host machine.

Essentially, the node-rapids system is provided as a backend to any HTTP client. At this time only limited functionality is available to load JSON files in the graphology graph dataset format, plus API requests to request Dataframes and their Columns via apache-arrow.

Two endpoints, graphology/nodes and graphology/edges specifically return pre-formatted arrays that can be used directly with the sigma.js renderer. An extra-large-graphs example PR is in the works that utilizes this GPU-accelerated data for rendering larger datasets than available via only CPU.

trxcllnt commented 2 years ago

@thomcom could you merge main into this PR? That should make the diff easier. We also need to remove any yarn.lock and package-lock.json files that aren't the top-level one. Thx.

trxcllnt commented 2 years ago

@thomcom I see multiple versions of Typescript in the yarn.lock file, which is probably why the CI job is failing.

thomcom commented 2 years ago

@thomcom I see multiple versions of Typescript in the yarn.lock file, which is probably why the CI job is failing.

Double checking that now.

thomcom commented 2 years ago

This is ready for final review!

thomcom commented 2 years ago

I'm cleaning up some whitespace/clang annoyances that maybe we can talk about why they were put in there later @trxcllnt otherwise this is indeed ready for re-review.

thomcom commented 2 years ago

This is fully baked. Ship it.