mitdbg / brad

A virtualization layer for cloud data infrastructures.
https://dsg.csail.mit.edu/projects/brad
MIT License
7 stars 1 forks source link

Extract schema information from the underlying connections, add Arrow schema conversion utility #497

Closed geoffxy closed 5 months ago

geoffxy commented 6 months ago

This PR modifies BRAD's connection code to extract schema information (the column names and types) from the underlying database connections. Each database has slightly different types, so we unify them in a "best effort" way for now. Later on we will have better support for specific SQL dialects.

High level summary of the changes