search

mara / mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
MIT License
2.07k stars 100 forks source link

add SQLServerDB support for ReadFile #49

Closed ghost closed 3 years ago

ghost commented 4 years ago

This PR adds SQL Server support for command ReadFile.

This is done by using the bcp command, officially supported from Microsoft for Linux and Mac via the mssql-tools.

ghost commented 3 years ago

@jankatins I have now a better solution and will close this PR. It is possible to get the piped data from /dev/stdin, so, there is no need for this custom implementation. I added a new PR here: https://github.com/mara/mara-db/pull/41

bcp is part of the SQL Server command line tools available for Linux, so, this is the first step moving into the direction of https://github.com/mara/mara-db/issues/39

I have to acknowledge that I never linked the implementation for BigQuery either, but @gathineou needed it. I asked him to check if he can use /dev/stdin as well (#50).