Data Types

[alecmocatta]

amadeus-types has three goals:

• have types that are supersets of equivalents in Parquet, Postgres, Rust stdlib, e.g.:
  • a DateTime can accept any valid Parquet, Postgres timestamp, while remaining lossless
• have a type that is a superset of all the above types:
  • Value enables dynamic and gradual data typing by not requiring the complete type at compile time
• optimise data layout for performance, e.g,:
  • List<Value> is optimised to be backed by Vec<u8> if all the value are Value::U8
  • List<Row> is optimised to be backed by a Vec<_> of each column – i.e. columnar, like Apache Arrow

What other data types are relevant?

Should amadeus_core::file::{PathBuf, OsString} be moved to amadeus-types?