StarRocks / starrocks-connector-for-apache-spark

Apache License 2.0
36 stars 53 forks source link

Support to configure thrift MAX_MESSAGE_SIZE #13

Open banmoy opened 1 year ago

banmoy commented 1 year ago

Scanning a big batch of data may reach the MaxMessageSize of thrift. One solution is to decrease starrocks.batch.size, but it will affect the performance. So we should add a configuration to increase the MAX_MESSAGE_SIZE. image