apache / incubator-streampark

Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
https://streampark.apache.org/
Apache License 2.0
3.86k stars 996 forks source link

[Bug] Path resolution exception when submitting tasks in remote mode on Windows environment #3534

Open linweijiang opened 8 months ago

linweijiang commented 8 months ago

Search before asking

Java Version

1.8

Scala Version

2.12.x

StreamPark Version

2.1.2(The dev branch has not yet addressed that)

Flink Version

1.18.1

deploy mode

remote

What happened

In services running locally on Windows using Idea, there is a path conversion exception when submitting tasks in remote mode.

Do we have a dedicated module or a utility class specifically for converting things for Windows? I've done a quick and dirty conversion and it works fine, but I feel it's not elegant enough. There are likely many more areas that require adaptation for the Windows environment.

Error Exception

Caused by: java.net.URISyntaxException: Illegal character in opaque part at index 2: D:\opt\streampark_workspace\workspace\100003\streampark-flinkjob_test-remote-yarn-local.jar
    at java.net.URI$Parser.fail(URI.java:2848)
    at java.net.URI$Parser.checkChars(URI.java:3021)
    at java.net.URI$Parser.parse(URI.java:3058)
    at java.net.URI.<init>(URI.java:588)
    at org.apache.flink.client.program.PackagedProgramUtils.resolveURI(PackagedProgramUtils.java:243)
    at org.apache.streampark.flink.client.trait.FlinkClientTrait.submit(FlinkClientTrait.scala:83)
    at org.apache.streampark.flink.client.trait.FlinkClientTrait.submit$(FlinkClientTrait.scala:60)
    at org.apache.streampark.flink.client.impl.RemoteClient$.submit(RemoteClient.scala:34)
    at org.apache.streampark.flink.client.FlinkClientHandler$.submit(FlinkClientHandler.scala:40)
    at org.apache.streampark.flink.client.FlinkClientHandler.submit(FlinkClientHandler.scala)

Screenshots

No response

Are you willing to submit PR?

Code of Conduct

chenshaojin commented 8 months ago

I think this is related to the issue of flink. https://wiki.avatr.com/pages/viewpage.action?pageId=21660370

chenshaojin commented 8 months ago

I just tested it, and the problem you mentioned does exist. Currently, submitting jobs on Windows does not meet this condition.

FrommyMind commented 2 weeks ago

I think this is related to the issue of flink. https://wiki.avatr.com/pages/viewpage.action?pageId=21660370

Cannot vist the site. got 403 error

dev-2.1.5 still has this issue