Open mehd-io opened 1 year ago
This would be great @mehd-io -- please send an impl my way!
Couple of things for you to keep in mind:
fsspec
-based filesysems, and Python jobs-- i.e., in your environment, trying to call load_source
or submit_python_job
should raise an exception. Oh and please add an integration test profile for your MD environment so we can run it as part of CI
As md environment differs slightly (and hopefully less in the future ;)) from duckDB, I was thinking of creating a dedicated environment class that would be loaded when users specify a path starting with
md:
I'm thinking of the following :md
token is presentWDYT? Happy to take a stab at it 🙂