Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Ballista gRPC messages can be very large when physical plans are referencing many partitions and we always have the risk of hitting the maximum message size.
Describe the solution you'd like
gRPC streams can be used to transmit data in chunks.
Is your feature request related to a problem or challenge? Please describe what you are trying to do. Ballista gRPC messages can be very large when physical plans are referencing many partitions and we always have the risk of hitting the maximum message size.
Describe the solution you'd like gRPC streams can be used to transmit data in chunks.
Describe alternatives you've considered
Additional context