MongoDB: Added Zyp transformations to the CDC subsystem,
making it more symmetric to the full-load procedure.
Query Converter: Added very basic expression converter utility with
CLI interface
DynamoDB: Added query expression converter for relocating object
references, to support query migrations after the breaking change
with the SQL DDL schema, by v0.0.27.
MongoDB: Added Zyp transformations to the CDC subsystem,
making it more symmetric to the full-load procedure.
Query Converter: Added very basic expression converter utility with
CLI interface
DynamoDB: Added query expression converter for relocating object
references, to support query migrations after the breaking change
with the SQL DDL schema, by v0.0.27.
2024/10/09 v0.0.28
IO: Improved BulkProcessor when running per-record operations by
also checking rowcount for handling INSERT OK, 0 rows responses
MongoDB: Fixed BSON decoding of {"$date": 1180690093000} timestamps
by updating to commons-codec 0.0.21.
Testcontainers: Don't always pull the OCI image before starting.
It is unfortunate in disconnected situations.
2024/10/01 v0.0.27
MongoDB: Updated to pymongo 4.9
DynamoDB: Change CrateDB data model to use (pk, data, aux) columns
Attention: This is a breaking change.
2024/09/26 v0.0.26
MongoDB: Configure MongoDBCrateDBConverter after updating to commons-codec 0.0.18
DynamoDB CDC: Fix MODIFY operation to also propagate deleted attributes
2024/09/22 v0.0.25
Table Loader: Improved conditional handling of "transformation" parameter
Table Loader: Improved status reporting and error logging in BulkProcessor
MongoDB: Improve error reporting
MongoDB Full: Polars' read_ndjson doesn't load MongoDB JSON data well,
use fsspec and orjson instead
MongoDB Full: Improved initialization of transformation subsystem
MongoDB Adapter: Improved performance of when computing collection cardinality
by using collection.estimated_document_count()
MongoDB Full: Optionally use limit parameter as number of total records
MongoDB Adapter: Evaluate _id filter field by upcasting to bson.ObjectId,
to convey a filter that makes ctk load table process a single document,
identified by its OID
MongoDB Dependencies: Update to commons-codec 0.0.17
2024/09/19 v0.0.24
MongoDB Full: Refactor transformation subsystem to commons-codec
MongoDB: Update to commons-codec v0.0.16
2024/09/16 v0.0.23
MongoDB: Unlock processing multiple collections, either from server database,
or from filesystem directory
MongoDB: Unlock processing JSON files from HTTP resource, using https+bson://
MongoDB: Optionally filter server collection using MongoDB query expression
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
Bumps cratedb-toolkit from 0.0.15 to 0.0.29.
Release notes
Sourced from cratedb-toolkit's releases.
... (truncated)
Changelog
Sourced from cratedb-toolkit's changelog.
... (truncated)
Commits
394e7ae
Release v0.0.29702dd50
Query Converter: Add very basic expression converter utility with CLI20904aa
MongoDB: Add integration test for the CDC subsystem48e4d77
MongoDB: Add Zyp transformations to the CDC subsystem88be2d2
Release v0.0.285d8435a
Testcontainers: Don't always pull the OCI image before starting.c6e42b9
MongoDB: Fix BSON decoding of{"$date": 1180690093000}
timestampse76a173
IO: ImproveBulkProcessor
when running per-record operationsa9c70a3
Update validate-pyproject requirement from <0.20 to <0.21d8f298b
Update poethepoet requirement from <0.29 to <0.30Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase
.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show