search

dockerzhang / incubator-inlong

Apache InLong - a one-stop data streaming platform
https://inlong.apache.org/
Apache License 2.0
0 stars 0 forks source link

[INLONG-112] Enhance the system's ability to sense consumption status #112

Open dockerzhang opened 3 years ago

dockerzhang commented 3 years ago

At present, consumption does not consider consumers' consumption capacity and the current data backlog of partitions at all, which is not very friendly to flexible management systems and needs to be adjusted.

1. Support the statistics and reports of consumer consumption speed: the consumption speed of each consumer allowed by the system can be counted, so that the consumption status of each consumer can be clearly understood;

2. Master supports dynamic adjustment of partition allocation strategy based on user consumption speed, data production speed and data backlog, so that the fastest consumer consumes the partition with the largest data backlog

3. Master supports data statistics of consumer groups.

JIRA link - [INLONG-112] created by gosonzhang

github-actions[bot] commented 2 years ago

This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this will be closed in 30 days.

github-actions[bot] commented 2 years ago

This issue is stale because it has been open 60 days with no activity.

github-actions[bot] commented 2 years ago

This issue is stale because it has been open for 60 days with no activity.