Private Datasets: `DatasetEntry` integration - Githubissues

kamu-data / kamu-cli

Next-generation decentralized data lakehouse and a multi-party stream processing network

https://kamu.dev

Other

300 stars 13 forks source link

Private Datasets: `DatasetEntry` integration #872

Closed s373r closed 1 day ago

s373r commented 2 days ago

Description

Closes: #871

Changed

Private Datasets, DatasetEntry integration that will allow us to build dataset indexing
- Added DatasetEntryService for message processing
- Added DatasetEntryIndexer for one-shot indexing
- Extend DatasetLifecycleMessageCreated with dataset_name field
- Introducing DatasetLifecycleMessageRenamed
Simplified error handling code in repositories
Hidden part of the test code behind the feature gate

Checklist before requesting a review

[x] Unit and integration tests added
[x] Compatibility:
- [x] Network APIs: ✅
- [x] Workspace layout and metadata: ✅
- [x] Configuration: ✅
- [x] Container images: ✅
[ ] Observability:
- [ ] Tracing / metrics: ✅
- [ ] Alerts:
[ ] Documentation:
- [x] Changelog: ✅
- [ ] Public documentation: ✅
[ ] Downstream effects:
- [ ] kamu-node: ✅
- [ ] kamu-web-ui: ✅
- [x] release-queue