[BLD] use Depot to pre-build Docker images

[codetheweb]

Extracted from https://github.com/chroma-core/chroma/pull/2393.

Somewhat surprisingly, it seems to only save ~15s (building locally vs. transferring image over network) but I think that gap will only widen in the future.

The speedup would also be far more substantial for the distributed tests that use Tilt, but unfortunately trying to do so results in a lot of strange bugs. Tilt claims the way to do this is with custom_build() instead of docker_build(), but after debugging for several hours I was unable to overcome strange bugs (related to caching I think). E.x. the first tilt up using custom_build()s succeeds, but the next invocation results in many containers spitting out messages like:

Error: failed to start container "migration": Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: exec: "/bin/sh": stat /bin/sh: no such file or directory: unknown

[github-actions[bot]]

Reviewer Checklist

Please leverage this checklist to ensure your code review is thorough before approving

Testing, Bugs, Errors, Logs, Documentation

• [ ] Can you think of any use case in which the code does not behave as intended? Have they been tested?
• [ ] Can you think of any inputs or external events that could break the code? Is user input validated and safe? Have they been tested?
• [ ] If appropriate, are there adequate property based tests?
• [ ] If appropriate, are there adequate unit tests?
• [ ] Should any logging, debugging, tracing information be added or removed?
• [ ] Are error messages user-friendly?
• [ ] Have all documentation changes needed been made?
• [ ] Have all non-obvious changes been commented?

  System Compatibility

• [ ] Are there any potential impacts on other parts of the system or backward compatibility?
• [ ] Does this change intersect with any items on our roadmap, and if so, is there a plan for fitting them together?

  Quality

• [ ] Is this code of a unexpectedly high quality (Readability, Modularity, Intuitiveness)