search

google / fhir-data-pipes

A collection of tools for extracting FHIR resources and analytics services on top of that data.
https://google.github.io/fhir-data-pipes/
Apache License 2.0
141 stars 80 forks source link

Create a generic solution for supporting multiple extensions for same resource type #980

Closed chandrashekar-s closed 2 months ago

chandrashekar-s commented 4 months ago

With the current solution created as part of the PR #924, we would consider only one of the extension when multiple extensions are configured (this is deterministic though). We need to come up with a generic solution that would support multiple extensions for same resource type. Discuss with the community and come to consensus on the solution.

Possible Options to consider:

  1. Implement the Pathling way of creating parquet schema for extensions (i.e., map based).
  2. Create a parquet schema at runtime which is a superset of all the configured extension schemas and use this superset schema for the conversions. There are libraries for merging Parquet/Avro schema (link