Replace infer_schema_length by infer_schema

[josevalim]

Today infer_schema_length has an awkward API, since setting it to nil is used to infer all columns and 0 is used to disable it.

I propose:

infer_schema: true | false | non_neg_integer()

Where true enables, false disables, and the integer configures the length. The default can be the same as today.

[cigrainger]

I like this, but what would we use for all rows? IIUC true -> default (1000 rows).

[josevalim]

true means all rows.

[lei0zhou]

thanks for improving this! just share a way duckdb did. it has two parameters,

• auto_detect: true | false
• sample_size: BIGINT (-1, mean all rows, default 20480)

ref: CSV Import – DuckDB CSV Auto Detection – DuckDB

I am more than happy to take a stab at this