Open harshalkothawade6 opened 2 years ago
after starting the listner i'm running the pyspark code it is giving below error. It would be very helpful if can resolve this
StreamingQueryException: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Z === Streaming Query === Identifier: all_tweets [id = 58cc493e-5a60-46db-8c27-461107615bca, runId = 6929181c-484c-4a46-b54c-6ba779581487] Current Committed Offsets: {} Current Available Offsets: {}
Current State: ACTIVE Thread State: RUNNABLE
Logical Plan: Repartition 1, true +- Project [word#17, polarity#20, subjectivity_detection(word#17) AS subjectivity#24] +- Project [word#17, polarity_detection(word#17) AS polarity#20] +- Project [regexp_replace(word#15, :, , 1) AS word#17] +- Project [regexp_replace(word#13, RT, , 1) AS word#15] +- Project [regexp_replace(word#11, #, , 1) AS word#13] +- Project [regexp_replace(word#9, @\w+, , 1) AS word#11] +- Project [regexp_replace(word#6, http\S+, , 1) AS word#9] +- Filter atleastnnonnulls(1, word#6) +- Project [CASE WHEN (word#3 = ) THEN cast(null as string) ELSE word#3 END AS word#6] +- Project [word#3] +- Generate explode(split(value#0, t_end, -1)), false, [word#3] +- StreamingDataSourceV2Relation [value#0], org.apache.spark.sql.execution.streaming.sources.TextSocketTable$$anon$1@189a2a2, TextSocketV2[host: 0.0.0.0, port: 5555]
after starting the listner i'm running the pyspark code it is giving below error. It would be very helpful if can resolve this
StreamingQueryException: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Z === Streaming Query === Identifier: all_tweets [id = 58cc493e-5a60-46db-8c27-461107615bca, runId = 6929181c-484c-4a46-b54c-6ba779581487] Current Committed Offsets: {} Current Available Offsets: {}
Current State: ACTIVE Thread State: RUNNABLE
Logical Plan: Repartition 1, true +- Project [word#17, polarity#20, subjectivity_detection(word#17) AS subjectivity#24] +- Project [word#17, polarity_detection(word#17) AS polarity#20] +- Project [regexp_replace(word#15, :, , 1) AS word#17] +- Project [regexp_replace(word#13, RT, , 1) AS word#15] +- Project [regexp_replace(word#11, #, , 1) AS word#13] +- Project [regexp_replace(word#9, @\w+, , 1) AS word#11] +- Project [regexp_replace(word#6, http\S+, , 1) AS word#9] +- Filter atleastnnonnulls(1, word#6) +- Project [CASE WHEN (word#3 = ) THEN cast(null as string) ELSE word#3 END AS word#6] +- Project [word#3] +- Generate explode(split(value#0, t_end, -1)), false, [word#3] +- StreamingDataSourceV2Relation [value#0], org.apache.spark.sql.execution.streaming.sources.TextSocketTable$$anon$1@189a2a2, TextSocketV2[host: 0.0.0.0, port: 5555]