Open jw-amazon opened 1 year ago
@jw-amazon , Thank you for the request. For our own prioritization, do you have a list of logical types that you are most needing?
I am mostly interested to be able to ingest to opensearch as date if that is the logical type, by default, it is ingested as numeric value.
Is your feature request related to a problem? Please describe.
Logical types are used to extend the types that parquet can be used to store, by specifying how the primitive types should be interpreted. This keeps the set of primitive types to a minimum and reuses parquet's efficient encodings. Currently, the logic types are ignored during the ingestion process.
Describe the solution you'd like An configuration option to allow OSI to ingestion data with logic type
Describe alternatives you've considered (Optional) Right now, I have to create another filed so OSI can ingest the field into the correct logic type (date)
Additional context Add any other context or screenshots about the feature request here.