Support use of Dbldatagen from Databricks Serverless environment

databrickslabs / dbldatagen

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines

https://databrickslabs.github.io/dbldatagen

Other

364 stars 61 forks source link

Support use of Dbldatagen from Databricks Serverless environment #292

Open ronanstokes-db opened 4 months ago

ronanstokes-db commented 4 months ago

Expected Behavior

Library can be installed and used on DB Serverless

Current Behavior

Issues with setting configuration (PYArrow settings)

Steps to Reproduce (for bugs)

Context

Your Environment

dbldatagen version used:
Databricks Runtime version:
Cloud environment used: