search

irods / irods

Open Source Data Management Software
https://irods.org
BSD 3-Clause "New" or "Revised" License
446 stars 141 forks source link

iadmin modresc rebalance command not logging rebalancing operations #3463

Closed kript closed 7 years ago

kript commented 7 years ago

in 4.1.10, the output doesn't appear to show when replicas are updated in a rebalance operation.

I ran the following;

irods-g1-dev@irods-g1-dev:~$ ils -l test2999.txt
  irods-g1-dev      1 root;replicate;red;red1;irods-seq-i02-de         1024 2017-01-31.10:21 & test2999.txt
  irods-g1-dev      2 root;replicate;green;green3;irods-seq-sr02-ddn-rd10-21-22-23         1024 2017-01-31.10:22 & test2999.txt
irods-g1-dev@irods-g1-dev:~$ irm -n 1 test2999.txt
irods-g1-dev@irods-g1-dev:~$ ils -l test2999.txt
  irods-g1-dev      2 root;replicate;green;green3;irods-seq-sr02-ddn-rd10-21-22-23         1024 2017-01-31.10:22 & test2999.txt
irods-g1-dev@irods-g1-dev:~$ iadmin modresc root rebalance
irods-g1-dev@irods-g1-dev:~$ ils -l test2999.txt
  irods-g1-dev      2 root;replicate;green;green3;irods-seq-sr02-ddn-rd10-21-22-23         1024 2017-01-31.10:22 & test2999.txt
  irods-g1-dev      3 root;replicate;red;red1;irods-seq-i04-bc         1024 2017-01-31.10:24 & test2999.txt

So the rebalance command did what it said it would do.

In the logs, however, there is no mention of having fixed a replication (apologies for the verbosity, we have a lot of dummy resources in dev to match production);

Jan 31 10:24:35 pid:1106 NOTICE: Agent process 25183 started for puser=irods-g1-dev and cuser=irods-g1-dev from XXX.XX.XX.XX
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods_r2_dev_sdb] - matching old count: 10 to new count 10
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i20-fg] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i20-de] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i20-bc] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i19-de] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i19-bc] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i18-fg] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i18-bc] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i17-de] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i19-fg] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i17-bc] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i16-de] - matching old count: 4 to new count 4
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i18-de] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i16-bc] - matching old count: 4 to new count 4
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i15-fg] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i15-de] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i17-fg] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i15-bc] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i14-fg] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i16-fg] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i14-de] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [red3] - matching old count: 39 to new count 39
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i14-bc] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i13-de] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i11-fg] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i12-fg] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i11-bc] - matching old count: 4 to new count 4
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i10-fg] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i09-fg] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i10-de] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i11-de] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i09-de] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i09-bc] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i08-fg] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i10-bc] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i08-de] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i12-de] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i13-fg] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i08-bc] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i13-bc] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i12-bc] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i07-fg] - matching old count: 4 to new count 4
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [red2] - matching old count: 34 to new count 34
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i06-fg] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i06-de] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i06-bc] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i05-bc] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i07-de] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i04-fg] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i04-bc] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i03-fg] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i05-de] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i03-de] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i03-bc] - matching old count: 5 to new count 5
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i07-bc] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i02-de] - matching old count: 4 to new count 4
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i05-fg] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i02-fg] - matching old count: 4 to new count 4
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i02-bc] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i04-de] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i01-fg] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i01-de] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-i01-bc] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [red1] - matching old count: 33 to new count 33
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [red] - matching old count: 106 to new count 106
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-42-43-44] - matching old count: 4 to new count 4
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-9-10-11] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-6-7-8] - matching old count: 6 to new count 6
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-33-34-35] - matching old count: 5 to new count 5
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-57-58-59] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-54-55-56] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-36-37-38] - matching old count: 4 to new count 4
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-51-52-53] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-39-40-41] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-g2-dev-sdb] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [green9] - matching old count: 30 to new count 30
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-48-49-50] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-45-46-47] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-39-40-41] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-42-43-44] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-36-37-38] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-33-34-35] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-9-10-11] - matching old count: 4 to new count 4
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-57-58-59] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-6-7-8] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-54-55-56] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [green8] - matching old count: 11 to new count 11
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-51-52-53] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-42-43-44] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-48-49-50] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-39-40-41] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-36-37-38] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-33-34-35] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-rd10-45-46-47] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-30-31-32] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-rd10-27-28-29] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [green7] - matching old count: 8 to new count 8
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-rd10-24-25-26] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-rd10-21-22-23] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-rd10-18-19-20] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-57-58-59] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-51-52-53] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-45-46-47] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-54-55-56] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-48-49-50] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-42-43-44] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [green6] - matching old count: 9 to new count 9
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-30-31-32] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-3-4-5] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-27-28-29] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-21-22-23] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-18-19-20] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-15-16-17] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-12-13-14] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-24-25-26] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-0-1-2] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-24-25-26] - matching old count: 4 to new count 4
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [green4] - matching old count: 9 to new count 9
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-30-31-32] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-27-28-29] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-24-25-26] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-3-4-5] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-21-22-23] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-18-19-20] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-15-16-17] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-12-13-14] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr03-ddn-gg07-0-1-2] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-21-22-23] - matching old count: 5 to new count 5
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [green3] - matching old count: 15 to new count 15
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-3-4-5] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-18-19-20] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-14-15-16] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-12-13-14] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-ra08-9-10-11] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-ra08-3-4-5] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-ra08-12-13-14] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-0-1-2] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-ra08-6-7-8] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-ra08-0-1-2] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [green2] - matching old count: 4 to new count 4
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-9-10-11] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-6-7-8] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-57-58-59] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-54-55-56] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-51-52-53] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-re12f-0] - matching old count: 4 to new count 4
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-48-49-50] - matching old count: 2 to new count 2
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr04-ddn-gc10-45-46-47] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-27-28-29] - matching old count: 4 to new count 4
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [green5] - matching old count: 18 to new count 18
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-39-40-41] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-36-37-38] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-33-34-35] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr02-ddn-rd10-15-16-17] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-30-31-32] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-24-25-26] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-27-28-29] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-21-22-23] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-18-19-20] - matching old count: 0 to new count 0
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [irods-seq-sr01-ddn-ra08-15-16-17] - matching old count: 1 to new count 1
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [green1] - matching old count: 3 to new count 3
Jan 31 10:24:36 pid:25183 NOTICE: rebalance for [green] - matching old count: 107 to new count 107

Should I see something? How would I know rebalance is doing its thing?

trel commented 7 years ago

Interesting, I would have expected to see...

       "rebalance for [%s] - updating object count from [%d] to [%d]",

from https://github.com/irods/irods/blob/4-1-stable/iRODS/server/core/src/miscServerFunct.cpp#L3215

kellerb commented 7 years ago

@trel that function, update_resource_object_count(), is used to update the cached object count of a resource (that is stored in r_resc_main) with a value recomputed with a genquery. That is fixing a different type of situation than data object replication.

@kript as of 4.1.10, it is not expected that a rebalance operation on a replication resource would log the replication of data objects. The only way to know at this point that the rebalance has done anything is through additional queries, e.g. your ils -l.

Would you want logging added to the replication resource for this?

kript commented 7 years ago

We would like a way to know what is being done, yes. This is related to #3409

For example, we currently have ~24k single objects with some or all of them in one of the two composite resources we have in a zone. Because it is hard to get the information about which single object is in which resource tree, and there is no feedback from the rebalance command we don't know how long the command has to run, or even if its doing anything! :-)

trel commented 7 years ago

Pulling this back into 4.1.11.

The logging will look something like this example:

proc_results_for_rebalance: rebalancing data id [10165] from [demoResc;unix3Resc] to [demoResc;unix2Resc]