date/time type handling

bcgov / CE_integratedroads

Merge multiple BC road datasets into a single layer for Cumulative Effects analysis

Apache License 2.0

1 stars 0 forks source link

date/time type handling #10

Closed smnorris closed 5 months ago

smnorris commented 5 months ago

An FTEN road in 103I has an invalid date https://github.com/bcgov/CE_integratedroads/actions/runs/8623151554/job/23635798692

smnorris commented 5 months ago

Appears to be a unix epoch issue? https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#date problematic value is likely 1969/09/22,103I?

smnorris commented 5 months ago

workaround with -fieldTypeToString Date

smnorris commented 5 months ago

The built in parquet date type does not support pre 1970 dates, but other types do - when writing to parquet from ogr, the date type should be specified / converted to timestamp.