airbnb / chronon

Chronon is a data platform for serving for AI/ML applications.
Apache License 2.0
673 stars 36 forks source link

Make sure there is a mutation table for mutation sources #766

Closed pengyu-hou closed 1 month ago

pengyu-hou commented 1 month ago

Summary

In this PR, we will check if there is a mutation table in the entity source to determine if it is a mutation source. The entity source itself is not enough.

Before this PR: In the Entity JoinSource case, it will try to generate the mutation data frame. However, there are no mutation related fields like is_before or mutation_time_column. Therefore, the job will exit early with some schema could not resolved error.

Why / Goal

Test Plan

Checklist

Reviewers

@airbnb/zipline-maintainers @nikhilsimha @hanyuli1995 @donghanz @ezvz