FetcherCLI: support fetching with local join conf file without uploading to metadata store - Githubissues

airbnb / chronon

Chronon is a data platform for serving for AI/ML applications.

Apache License 2.0

673 stars 36 forks source link

FetcherCLI: support fetching with local join conf file without uploading to metadata store #753

Closed pengyu-hou closed 2 months ago

pengyu-hou commented 2 months ago

Summary

This PR will enable users to use a local join conf file to fetch features without uploading the conf to metadata store.

Why / Goal

It will simplify the testing process.

Test Plan

[ ] Added Unit Tests
[ ] Covered by existing CI
[ ] Integration tested

[x] tested on gateway macine


python3 ./scripts/run.py --mode=fetch -k '<place_holder>' --conf-path <place_holder> -t join --chronon-jar ~/test/chronon-embedded.jar

2024-04-24 21:09:16 INFO Fetcher:391 - Using passed in join configuration:



## Checklist
- [ ] Documentation update

## Reviewers
@airbnb/zipline-maintainers @nikhilsimha @hanyuli1995 @donghanz