[INLONG-116] Support load balancing customization

[dockerzhang]

In addition to adding the client-side load balancing management and control functions, the current server-side load balancing management and control functions should also be expanded, such as supporting multiple sensing functions, including nearby access capabilities, small cluster distribution awareness, etc., implemented in a softer way Function of balancing operation:

1. Support partitions on the same broker as much as possible to be distributed to the same consumer. This feature allows consumers to initiate a check on these partitions to obtain all partition data and reduce network pressure；

2. The load balancing protocol should consider checking the stability of the client, and allocate as little partition data as possible to unstable consumers to avoid consumption lag;

3. The load balancing protocol should consider adding the partition forced allocation mode to avoid the situation that the client still occupies the partition when the client is abnormal;

4. Support customization of load balancing: support each consumer group to define different load balancing schemes.

JIRA link - [INLONG-116] created by gosonzhang

[github-actions[bot]]

This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this will be closed in 30 days.

[github-actions[bot]]

This issue is stale because it has been open 60 days with no activity.

[github-actions[bot]]

This issue is stale because it has been open for 60 days with no activity.