Closed mmcdermott closed 2 weeks ago
The changes involve modifications to the extract_statics_and_schema
function in the tokenization.py
file, specifically altering the join operation to a full join and adding a coalesce=True
parameter. Additionally, the test suite in test_tokenization.py
has been enhanced with new data structures and expanded tests to validate the updated transformation logic.
Files | Change Summary |
---|---|
src/MEDS_transforms/transforms/tokenization.py , tests/MEDS_Transforms/test_tokenization.py |
The extract_statics_and_schema function now performs a full join with a coalesce=True parameter. The test suite has been expanded with new DataFrames and dictionaries to improve validation of the tokenization process. |
sequenceDiagram
participant User
participant TokenizationFunction
participant DataFrames
User->>TokenizationFunction: Call extract_statics_and_schema(df)
TokenizationFunction->>DataFrames: Perform full join on static_by_subject and schema_by_subject
DataFrames-->>TokenizationFunction: Return joined DataFrame
TokenizationFunction->>User: Return processed DataFrame
🐇 In the meadow where data flows,
A full join blooms, as knowledge grows.
With coalesce, we mend the gaps,
Transforming numbers, like gentle taps.
Oh, what joy in tests we find,
Validating changes, oh so kind! 🌼
Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?
:warning: Please install the to ensure uploads and comments are reliably processed by Codecov.
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 94.23%. Comparing base (
3519769
) to head (b43abd1
). Report is 1 commits behind head on main.
:white_check_mark: All tests successful. No failed tests found.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
Summary by CodeRabbit
New Features
Bug Fixes
Tests