search

apache / datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine
https://datafusion.apache.org/ballista
Apache License 2.0
1.39k stars 181 forks source link

Could not deserialize ballista_core::serde::generated::ballista::JobStatus (invalid wire type) #417

Open andygrove opened 1 year ago

andygrove commented 1 year ago

Describe the bug

thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Plan("ArrowError(ExternalError(Execution(\"Status { code: Internal, message: \\\"Error getting status for job MkRmAvo: Internal(\\\\\\\"Could not deserialize ballista_core::serde::generated::ballista::JobStatus: failed to decode Protobuf message: JobStatus.status: invalid wire type value: 6\\\\\\\")\\\", metadata: MetadataMap { headers: {\\\"content-type\\\": \\\"application/grpc\\\", \\\"date\\\": \\\"Fri, 21 Oct 2022 00:34:24 GMT\\\", \\\"content-length\\\": \\\"0\\\"} }, source: None }\")))")', benchmarks/src/bin/tpch.rs:39

To Reproduce Run benchmarks at SF=10 in docker-compose

Expected behavior A clear and concise description of what you expected to happen.

Additional context Add any other context about the problem here.

andygrove commented 1 year ago

May have been triggered by this:

ballista-executor_1   | 2022-10-21T00:40:12.765327Z DEBUG          task_runner ThreadId(85) ballista_executor::execution_loop: Statistics: Err(DataFusionError(ArrowError(InvalidArgumentError("46412468576820000 is too large to store in a Decimal128 of precision 15. Max is 999999999999999"))))    
ballista-executor_1   | 2022-10-21T00:40:12.765415Z  INFO          task_runner ThreadId(85) ballista_executor: Task 8 failed: DataFusion error: ArrowError(InvalidArgumentError("46412468576820000 is too large to store in a Decimal128 of precision 15. Max is 999999999999999"))