Open CodeCox opened 8 months ago
Can reproduce.
An initial attempt to debug what is happening:
It seems that scan_csv
calls .with_dtypes()
Which sets schema_overwrite
to the schema
The schema is col1: Date, col2: String
at this point (not sure where the Date parsing has been done?)
This becomes fixed_schema
Causing parse_dates
to return early leaving col2
as a String type:
Checks
Reproducible example
Log output
No response
Issue description
scan_csv( ... , try_parse_dates=True)
is not parsing a time column. (use case: This string format is obtained from an csv export from an Outlook Calendar)read_csv( ... , try_parse_dates=True)
is able to handle this string format. (There are various discussions about parity between `read&
scan` so I will not rehash those issues here.)Expected behavior
should be parsed as in
read_csv()
ie. column should have a time dtypeInstalled versions