Handle null fields in avro schema in StreamlineEvent

hortonworks / streamline

StreamLine - Streaming Analytics

Apache License 2.0

164 stars 95 forks source link

Handle null fields in avro schema in StreamlineEvent #821

Open priyank5485 opened 7 years ago

priyank5485 commented 7 years ago

This issue is raised as a follow up to the discussion that took place at https://github.com/hortonworks/streamline/pull/775

Avro schema with null fields should be handled correctly and a contract should be established so Custom Processors, UDFS, UDAFs, etc can all work relying on that contract.

Marking it as a bug since master does not have a fix for null fields. The fix from the PR 775 was only pushed to HDF-3.0-maint branch for the next release.

arunmahadevan commented 7 years ago

@priyank5485 , I cherry picked 70c8237b5bfac1a82103c53a244afb5c0fdd0068 into master since I was trying to merge the master to HDF-3.1 and keeping both in sync and noticed the difference. I realized you have a raised a github issue here later.

You can close this issue if you think the commit addresses the issue or if you plan to address it in a different way, raise a new issue and apply on top of your fix.