Add delay before querying base ref

[Mark-Simulacrum]

This is another attempt to fix the 422 fast forward errors we've been getting.

cc https://github.com/rust-lang/homu/issues/75