This PR update convert_delta_to_json script to make it usable with databricks-connect >=14.3.
Current convert_delta_to_jsonl requires databricks-connect pin to 14.1.0. The reason was that when the script was developed we needed to monkeypatch SparkClient. The monkeypatched code can only work with dbconnect==14.1. Later versions of databricks-connect added the monkeypatch function.
This PR update convert_delta_to_json script to make it usable with databricks-connect >=14.3.
Current convert_delta_to_jsonl requires databricks-connect pin to 14.1.0. The reason was that when the script was developed we needed to monkeypatch SparkClient. The monkeypatched code can only work with dbconnect==14.1. Later versions of databricks-connect added the monkeypatch function.