tse-lao / hackathon-fvm

DataBridge
https://hackathon-fvm-fj45.vercel.app
2 stars 2 forks source link

Bacalhau Computations Workflow #28

Closed tse-lao closed 1 year ago

tse-lao commented 1 year ago

@tse-lao

@nijoe1

tse-lao commented 1 year ago

@nijoe1 I will add the jobID once the function is there, when the results are done we can request the result of the job. if the result is completed we can update the status, otherwise we just leave it open. This reduced the workload to subscribe to job_id and track if its updated. For now this seems to be a valid way of doing it. In the future we might need to consider another consideration.

nijoe1 commented 1 year ago

To scale the process we can assign more than one executor ( Bacalhau servers ). When a server receives an execution Request it will check if this request is taken from another one. When a server is running a job it could also listen to events and add them to a queue. Another thing to consider is to use libp2p to create a network for our servers to communicate and execute things efficiently.