If the acceptance rate is too low it takes more tries to go from one temperature to the other, if the acceptance rate is too high, that means that we need to cross more temperatures to get to the same temperature difference.
To find out the optimal acceptance rate we need to compare two situations.
1) beta0, beta1, beta2
2) beta0, beta2
in situation 1 we have twice as many temperature steps, and therefore half as many walkers per temperature.
Then situation 1 is better if
which is the optimal number of temperatures?
If the acceptance rate is too low it takes more tries to go from one temperature to the other, if the acceptance rate is too high, that means that we need to cross more temperatures to get to the same temperature difference.
To find out the optimal acceptance rate we need to compare two situations.
1) beta0, beta1, beta2
2) beta0, beta2
in situation 1 we have twice as many temperature steps, and therefore half as many walkers per temperature. Then situation 1 is better if
now lets assume that the acceptance is in the pure exponential regime:
If we equilibrate acceptances then
lets assume that
then
then
now, it is easy to prove that
Then situation (double the temperatures) is surely better for acceptances equal or lower to 0.25