Bootstrap network - Githubissues

egeberkaygulcan / dstest

3 stars 1 forks source link

Bootstrap network #2

Closed joaomlneto closed 4 months ago

joaomlneto commented 5 months ago

This is the hello world for the listeners.

Includes a TCP Interceptor and an HTTP Interceptor for now.

The requests are then queued, but not a lot beyond that has been done.

Some changes required on your end:

[ ] Remove the absolute paths (/Users/berkay/)

Some manual changes required between intercepting TCP payloads and HTTP payloads.

Intercepting HTTP

Change in hello.py: comment lines 35-50, and uncomment from line 51.
In network/manager.go line 29: instantiate a HTTPInterceptor: nm.Interceptors[i] = new(HTTPInterceptor)

Intercepting using Sockets

Change in hello.py: uncomment lines 35-50, and comment from line 51.
In network/manager.go line 29: instantiate a TCPInterceptor: nm.Interceptors[i] = new(TCPInterceptor)

joaomlneto commented 4 months ago

@egeberkaygulcan I think this is good to merge. It has lots of 🍝code that does the basic networking stuff, held together by a "Network Manager":

interceptors listen on ports [10000,10000+N): currently TCP sockets only; needs to support HTTP/gRPC, but we need to talk :)
interceptors post the message to the router
router posts message to recipient's message queues if there is connectivity

Messages are not yet sent back to the replicas.

I've poked the process manager code a bit and may have induced pesky merge conflicts: needed to add a few params to pass to the workers (their ID, interceptor ports, num replicas).