awslabs / python-deequ

Python API for Deequ
Apache License 2.0
702 stars 132 forks source link

Start the callback server with the random port #16

Closed ricdong closed 3 years ago

ricdong commented 3 years ago

The PythonCallback is always bound to port 25334 by default, which will cause the same pyspark program to not run on the same server.

We added parameters so that the callback server can run on a random port.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.