amark / gun

An open source cybersecurity protocol for syncing decentralized graph data.
https://gun.eco/docs
Other
18.05k stars 1.16k forks source link

AWS Neptune Integration #1158

Open windbeneathyourwings opened 2 years ago

windbeneathyourwings commented 2 years ago

I have been investigating various ways to integrate GUN with Neptune for readonly metrics generated by user behavior.

Research has revealed that the straight forward approach would be to create a gremlin http adaptor using flint. However, I only consider this option appropriate for development. On production it seems like the best approach is to upload gremlin csv files to s3 and load them into Neptune. I saw an s3 adaptor but that doesn't really work for the Neptune integration use case. This is especially true since I'm using the client-side v3 sdk and would be pushing those files up directly from the browser within a serverless ecosystem of interconnected parts mostly on aws.

After conducting initial research this seems like the best approach to integrate with AWS Neptune in a production grade manor while falling back to gremlin http for local dev against AuraDB since it is free for development. Any thoughts or insights on this approach perhaps something I'm overlooking. I have created an initial architecture document explaining the goals that I wish to achieve that include gun as part of architecture.

https://github.com/ng-druid/platform/wiki/Architecture:-Sparkle

i001962 commented 2 years ago

Join the chat.gun.eco and ask there.