sourcegraph / sourcegraph-public-snapshot

Code AI platform with Code Search & Cody
https://sourcegraph.com
Other
10.1k stars 1.28k forks source link

Perforce depot clones deleted from gitserver without any indication of why #56902

Closed mike-r-mclaughlin closed 9 months ago

mike-r-mclaughlin commented 1 year ago

Overview

On several instances over the past couple of weeks, the Git repository mirror of a Perforce depot has mysteriously been deleted from disk and started re-cloning. For smaller git repos, this is not an issue because the repo can re-clone quickly. However, for Perforce depots, this re-clone can take hours.

Suggestions for improvement:

/cc @sourcegraph/source

eseliger commented 9 months ago

We should see improvements in 5.3 wrt. corruption detection that might delete repositories. In addition, a purge worker that would try to make sure ample disk space is remaining that didn't actually fix the issue in the long-run because we would reclone has been disabled for customer instances, preventing "ghost deletes".

These two things together are the only sources that I could see which might cause this behavior, so unless the customer is still seeing this issue after upgrading to 5.3, I will consider this not a problem anymore.