mxsm / rocketmq-rust

🚀Apache RocketMQ Rust implementation. Faster, safer, and with lower memory usage.
https://docs.rs/rocketmq-rust
Apache License 2.0
538 stars 66 forks source link

[ISSUE #741]🚀Implement ExpressionMessageFilter tags🔥 #742

Closed mxsm closed 2 months ago

mxsm commented 2 months ago

Which Issue(s) This PR Fixes(Closes)

Fixes #741

Brief Description

How Did You Test This Change?

Summary by CodeRabbit

mxsm commented 2 months ago

🚀Thanks for your contribution🎉. CodeRabbit(AI) will review your code first🔥

coderabbitai[bot] commented 2 months ago

Walkthrough

The changes introduce improvements to RocketMQ's broker system by making ConsumerFilterData fields optional, enhancing the ExpressionMessageFilter, refining the ConsumerFilterManager, adding new configuration options, and implementing expression evaluation capabilities. These modifications enhance support for consumer filtering based on tags or expressions.

Changes

File(s) Change Summary
rocketmq-broker/src/filter/consumer_filter_data.rs Updated ConsumerFilterData struct fields to be optional and adjusted setter methods accordingly.
rocketmq-broker/src/filter/expression_message_filter.rs Added imports, fields, a constructor to ExpressionMessageFilter, and implemented matching methods.
rocketmq-broker/src/filter/manager/consumer_filter_manager.rs Enhanced ConsumerFilterManager by adding new fields and methods, and adjusting existing methods for optional parameters.
rocketmq-broker/src/filter/manager/consumer_filter_wrapper.rs Removed Debug trait and changed topic field type in FilterDataMapByTopic.
rocketmq-broker/src/processor/pull_message_processor.rs Simplified consumer_filter_data construction and enhanced ExpressionMessageFilter instantiation.
rocketmq-common/src/common/broker/broker_config.rs Added new configuration fields and applied the Clone trait to BrokerConfig, TopicQueueConfig, and TimerWheelConfig.
rocketmq-filter/src/expression.rs Introduced a new module for expression evaluation, defining the Expression trait.
rocketmq-filter/src/lib.rs Added expression module.
rocketmq-filter/src/utils.rs Added bloom_filter module.
rocketmq-remoting/src/protocol/filter/filter_api.rs Modified FilterAPI method to handle ExpressionType::TAG differently and simplify subscription_data.expression_type assignment.
rocketmq-remoting/src/protocol/heartbeat/subscription_data.rs Updated SubscriptionData's Default implementation to use ExpressionType::TAG and set sub_version using get_current_millis().

Sequence Diagram(s)

sequenceDiagram
    participant Broker
    participant FilterAPI
    participant ExpressionMessageFilter
    participant ConsumerFilterManager

    Broker ->> FilterAPI: Parse subscription data
    FilterAPI ->> Broker: Returns SubscriptionData
    Broker ->> ConsumerFilterManager: Build/Set Up Filter
    ConsumerFilterManager ->> Broker: Returns Filter
    Broker ->> ExpressionMessageFilter: Create Message Filter
    ExpressionMessageFilter ->> Broker: Message Filter Available
    Broker ->> ExpressionMessageFilter: Check if message matches filter
    ExpressionMessageFilter ->> Broker: Return match result

Assessment against linked issues

Objective (Issue #741) Addressed Explanation
Implement ExpressionMessageFilter tags

In RocketMQ the changes flow, Improved filters now aptly show. Expressions tag, they mark and sort, With harmony, brokers now report. 🐰✨ In code, the balance we maintain, As messages through filters gain.


Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?

Share - [X](https://twitter.com/intent/tweet?text=I%20just%20used%20%40coderabbitai%20for%20my%20code%20review%2C%20and%20it%27s%20fantastic%21%20It%27s%20free%20for%20OSS%20and%20offers%20a%20free%20trial%20for%20the%20proprietary%20code.%20Check%20it%20out%3A&url=https%3A//coderabbit.ai) - [Mastodon](https://mastodon.social/share?text=I%20just%20used%20%40coderabbitai%20for%20my%20code%20review%2C%20and%20it%27s%20fantastic%21%20It%27s%20free%20for%20OSS%20and%20offers%20a%20free%20trial%20for%20the%20proprietary%20code.%20Check%20it%20out%3A%20https%3A%2F%2Fcoderabbit.ai) - [Reddit](https://www.reddit.com/submit?title=Great%20tool%20for%20code%20review%20-%20CodeRabbit&text=I%20just%20used%20CodeRabbit%20for%20my%20code%20review%2C%20and%20it%27s%20fantastic%21%20It%27s%20free%20for%20OSS%20and%20offers%20a%20free%20trial%20for%20proprietary%20code.%20Check%20it%20out%3A%20https%3A//coderabbit.ai) - [LinkedIn](https://www.linkedin.com/sharing/share-offsite/?url=https%3A%2F%2Fcoderabbit.ai&mini=true&title=Great%20tool%20for%20code%20review%20-%20CodeRabbit&summary=I%20just%20used%20CodeRabbit%20for%20my%20code%20review%2C%20and%20it%27s%20fantastic%21%20It%27s%20free%20for%20OSS%20and%20offers%20a%20free%20trial%20for%20proprietary%20code)
Tips ### Chat There are 3 ways to chat with [CodeRabbit](https://coderabbit.ai): - Review comments: Directly reply to a review comment made by CodeRabbit. Example: - `I pushed a fix in commit .` - `Generate unit testing code for this file.` - `Open a follow-up GitHub issue for this discussion.` - Files and specific lines of code (under the "Files changed" tab): Tag `@coderabbitai` in a new review comment at the desired location with your query. Examples: - `@coderabbitai generate unit testing code for this file.` - `@coderabbitai modularize this function.` - PR comments: Tag `@coderabbitai` in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples: - `@coderabbitai generate interesting stats about this repository and render them as a table.` - `@coderabbitai show all the console.log statements in this repository.` - `@coderabbitai read src/utils.ts and generate unit testing code.` - `@coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.` - `@coderabbitai help me debug CodeRabbit configuration file.` Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. ### CodeRabbit Commands (invoked as PR comments) - `@coderabbitai pause` to pause the reviews on a PR. - `@coderabbitai resume` to resume the paused reviews. - `@coderabbitai review` to trigger an incremental review. This is useful when automatic reviews are disabled for the repository. - `@coderabbitai full review` to do a full review from scratch and review all the files again. - `@coderabbitai summary` to regenerate the summary of the PR. - `@coderabbitai resolve` resolve all the CodeRabbit review comments. - `@coderabbitai configuration` to show the current CodeRabbit configuration for the repository. - `@coderabbitai help` to get help. Additionally, you can add `@coderabbitai ignore` anywhere in the PR description to prevent this PR from being reviewed. ### CodeRabbit Configration File (`.coderabbit.yaml`) - You can programmatically configure CodeRabbit by adding a `.coderabbit.yaml` file to the root of your repository. - Please see the [configuration documentation](https://docs.coderabbit.ai/guides/configure-coderabbit) for more information. - If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: `# yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json` ### Documentation and Community - Visit our [Documentation](https://coderabbit.ai/docs) for detailed information on how to use CodeRabbit. - Join our [Discord Community](https://discord.com/invite/GsXnASn26c) to get help, request features, and share feedback. - Follow us on [X/Twitter](https://twitter.com/coderabbitai) for updates and announcements.