airbytehq / PyAirbyte

PyAirbyte brings the power of Airbyte to every Python developer.
https://docs.airbyte.com/pyairbyte
Other
176 stars 20 forks source link

💡 Feature Request: Provide more robust handling of `anyOf(string, object)` scenarios #253

Open aaronsteers opened 1 month ago

aaronsteers commented 1 month ago

Related to issues discovered during work on these PRs:

We currently fall back to string type as a failsafe whenever we get a type we can't type properly. For cases where the field is defined as anyOf(string, object), aka type = ["string", "object"] or type = ["null", "string", object"], we are considering changing the behavior so that the value would be stored in a JSON-like field, such as JSON or VARIANT.

These JSON-like types are capable of holding "bare" string values as well as other variant data.