luminousmen / data-toolset

Upgrade from avro-tools and parquet-tools jars to a more user-friendly Python package.
MIT License
2 stars 0 forks source link

Make parquet validation work with avsc schemas #7

Open luminousmen opened 1 year ago

luminousmen commented 1 year ago

Currently, our Parquet validation process does not support Avro schemas (AVSC files). To enhance our data validation capabilities, we need to implement support for validating Parquet files using Avro schemas.

AC:

Mukku27 commented 4 weeks ago

@luminousmen i would like to work on it please assign it to me