grc-iit / ChronoLog

ChronoLog: A High-Performance Storage Infrastructure for Activity and Log Workloads
https://chronolog.dev
BSD 2-Clause "Simplified" License
5 stars 4 forks source link

Support non-uniform RecordingGroup size #167

Closed fkengun closed 1 week ago

fkengun commented 4 months ago

Current distributed deployment script forces #grapher to be a divisor of #keeper. This means the RecordingGroup size has to be the same for the entire deployment. In a more realistic system, RecordingGroup size may not be the same for all groups. Thus, the deployment script should support non-uniform RecordingGroup size. Hosts files for different ChronoKeepers in different RecordingGroups can be generated by assigning Keeper nodes to groups in a round-robin fashion. As long as the hosts files are correct, the conf file for those Keepers can be generated accordingly. During launch, Keepers can read from the correct conf file using the group id and its hostname.