Closed 51-code closed 4 months ago
Describe the bug
The query: index=abc earliest=-10y | accum offset results in a StreamingQueryException and a RuntimeException.
index=abc earliest=-10y | accum offset
org.apache.spark.sql.streaming.StreamingQueryException: Job aborted due to stage failure: Task 66 in stage 211.0 failed 4 times ...
java.lang.RuntimeException: java.lang.String is not a valid external type for schema of bigint ...
However, providing the output field works: index=abc earliest=-10y | accum offset AS a_offset
index=abc earliest=-10y | accum offset AS a_offset
Expected behavior
Should work without the output field, resulting in the overwrite of the field that was specified in the query.
How to reproduce
Run the queries above.
Screenshots
Software version
PTH-10: 4.18.0-8-ge7e4190c
Desktop (please complete the following information if relevant):
Additional context
Note: It works if the source field is StringType.
this was fixed in 4.20.1
Describe the bug
The query:
index=abc earliest=-10y | accum offset
results in a StreamingQueryException and a RuntimeException.org.apache.spark.sql.streaming.StreamingQueryException: Job aborted due to stage failure: Task 66 in stage 211.0 failed 4 times ...
java.lang.RuntimeException: java.lang.String is not a valid external type for schema of bigint ...
However, providing the output field works:
index=abc earliest=-10y | accum offset AS a_offset
Expected behavior
Should work without the output field, resulting in the overwrite of the field that was specified in the query.
How to reproduce
Run the queries above.
Screenshots
Software version
PTH-10: 4.18.0-8-ge7e4190c
Desktop (please complete the following information if relevant):
Additional context