Predict was out of date with new server Forward method which sends a BatchedRequest with potentially multiple input dicts.
Predict now generates output for each input dict and returns list of outputs as expected by Forward. Predict was also returning output as bytes but proto Structs don't take bytes as a valid value so now predict returns output as string.
Predict was out of date with new server Forward method which sends a BatchedRequest with potentially multiple input dicts. Predict now generates output for each input dict and returns list of outputs as expected by Forward. Predict was also returning output as bytes but proto Structs don't take bytes as a valid value so now predict returns output as string.