`LOAD DATA IN FILE` - Githubissues

apecloud / myduckserver

MySQL & Postgres Analytics, Reimagined

187 stars 9 forks source link

`LOAD DATA IN FILE` #69

Closed fanyang01 closed 2 months ago

fanyang01 commented 2 months ago

Modern MySQL copy & import tools (e.g., MySQL Shell's copy utilities) utilize the LOAD DATA INFILE statement for bulk loading. We should add first-class support for it to make the setup experience more pleasant.

We have two options:

Implement the InsertableTable interface and let go-mysql-server parse the file and insert the records.
Rewrite the statement to a DuckDB SQL and let DuckDB ingest the file.

The latter approach should be faster, but it cannot ensure 100% compatibility.

GaoYusong commented 2 months ago

Speed is more important in this scenario.