search

exasol / databricks-virtual-schema

Virtual Schema for connecting Databricks as a data source to Exasol
MIT License
0 stars 0 forks source link

Implement paging for Databricks API #8

Open kaklakariada opened 2 months ago

kaklakariada commented 2 months ago

Databricks API uses paging when listing data, e.g. tables. So currently the VS only finds at most 50 tables, because it does not implement paging.

To support an arbitrary number of tables, we need to implement paging when retrieving data from the Databricks API.