Previously, the server always initialized a Context object as all pipelines used the MultiModelEngine which requires a Context input. Context always uses the elastic scheduler
With this PR, for the case where continuous_batch_sizes are provided, a Context object is not used during pipeline initialization and a single stream scheduler is selected.
This prevents us from using the MultiModelEngine for this case but any other pipeline initialized without continuous_batch_sizes will use Context/MultiModelEngine
Summary:
Contextobject as all pipelines used theMultiModelEnginewhich requires aContextinput.Contextalways uses theelasticschedulercontinuous_batch_sizesare provided, aContextobject is not used during pipeline initialization and a single stream scheduler is selected.MultiModelEnginefor this case but any other pipeline initialized withoutcontinuous_batch_sizeswill useContext/MultiModelEngine