search

mrsnu / band

Multi-DNN Inference Engine for Heterogeneous Mobile Processors
Other
23 stars 2 forks source link

Preparation for splash #286

Closed widiba03304 closed 1 year ago

widiba03304 commented 1 year ago

List of changes

  1. Estimators
    • Moved latency_estimator.* to estimator/latency_estimators
    • Engine now has multiple estimators
    • ResourceMonitor is initialized when an Engine is created.
    • Each scheduler now has to specify their requirements of estimators with GetEstimatorTypes.
  2. Graph
    • Simple graph representation with Graph
    • GraphBuilder has multiple Invariants which check the validity of the constructed graph by the builder

After this PR is merged, I will create another PR that integrates a gRPC client and a bunch of protobuf defining the messages between server and client.

widiba03304 commented 1 year ago

Decided to move Splash's implementation as a separate repo.