Open apatrida opened 1 week ago
@apatrida sad to hear, thanks for reporting, could please post the
if it's possible
Driver and Dataframe are coming from %use mysql, dataframe
so are whatever version it is pulling, most recent as of July 1, 2024.
DB is MySQL (Percona server distribution) 8.0.34
Notebook attached. PerfQueries.ipynb.zip
You just need to add these three env variables to point at a mysql database that has performance schema enabled (default settings are probably correct).
val URL = "jdbc:mysql://${System.getenv("DB_HOST")}:3306/performance_schema"
val USER_NAME = System.getenv("DB_USER")
val PASSWORD = System.getenv("DB_PASS")
or modify the notebook to hard coded values.
Note that a fair number of jdbc / sql things don't work as expected in notebooks. This isn't the only problem encountered. Listing table schemas errors out as it expects no database selected, but the driver doesn't function without database selected. I think the test suite might need to be more robust for MySQL.
Good afternoon, thanks for the detailed feedback, we will definitely check your example and try to solve some of the problems in the next release 0.14. Thanks for the help!
DataFrame fails on simple actions with casting BigInteger to Long.
For example, the MySQL performance schema table_handles table is defined as:
In the dataframe:
Read the SQL table:
results in error:
almost any actions does this no matter if working with the numeric type or not.