project-jcarbon / jcarbon

1 stars 2 forks source link

Build a JCarbon server #20

Open atpoverload opened 7 months ago

atpoverload commented 7 months ago

We want to support cross-language use cases for our system. To accomplish this, we are going to build a server that can be controlled through some external caller. We have a crude protoype that uses grpc in https://github.com/project-jcarbon/jcarbon/blob/service-prototype/service/src/main/java/jcarbon/server/JCarbonServerImpl.java as well as some tensorflow utilities https://github.com/project-jcarbon/jcarbon/blob/service-prototype/service/src/main/python/jcarbon/tensorflow.py.

One problem is that this server can currently only dump data to a file path. We should figure out what information we want to be able to send over the wire and how to structure it. We could send a json text blob but that doesn't seem like a good plan.

atpoverload commented 2 months ago

We have worked out a decent amount of this, but now we want to consider decomposing the main server into sub-servers, and if the signal datastructure is easy to consume.