Xuanwo
commented
8 months ago [2024-01-31T10:42:28Z INFO sccache::server] shutting down due to being idle or request
[2024-01-31T10:42:28Z INFO sccache::server] moving into the shutdown phase now, waiting at most 10 seconds for all client requests to complete
sccache: error: timed out
[2024-01-31T11:03:20Z INFO sccache::server] start_server: port: 35555
[2024-01-31T11:03:20Z INFO sccache::server] No scheduler address configured, disabling distributed sccacheOk, I'm guessing sccache is shuting down for idle. Like, the compiler is performing some slow tasks that longer than 600s (the default idle time for sccache).
Please try setting SCCACHE_IDLE_TIMEOUT to 0 to disable such behavior.
akashchi
sylvestre
dorloff
xiaoluzi0050
Hi,
We are experiencing unexpected
sccacheserver shutdowns when building our C++ project (OpenVINO) for RISC-V with Conan in GitHub Actions.Here is the setup:
sccachev0.7.5 is installed usingmozilla-actions/sccache-action@v0.0.3cmake,ninjaandconansccacheis using the remote Azure Blob Storage cacheCmake - Buildin theBuildjobThe project building goes well for almost all of the files and
sccacheis working as expected - getting files from/to cache - but at the end of the building stage (like 5998 out of 6000 files) the following warning appears:sccache: warning: The server looks like it shut down unexpectedly, compiling locally instead, the building process hangs for about 30 minutes and then succeeds.If
--show-statsis used after the build, it reports something like this:Building for other OS and architecture combinations works fine with
sccache.The same build works fine if
ccacheis used.Please see the workflow and
sccachelogs attached with timestamps: full_workflow_logs.zip sccache_log.zipEdit №1: there are a lot of files like
/github/home/.conan2/p/b/pugix9d6c6893d82cb:2024-01-31T15:19:29.3851510Z [5133/5143] : && /usr/bin/riscv64-linux-gnu-g++ -Wsuggest-override -Wno-deprecated-declarations -fsigned-char -ffunction-sections -fdata-sections -fdiagnostics-show-option -Wall -Wundef -Wall -Wno-unused-variable -Wno-unused-but-set-variable -O3 -DNDEBUG -Wformat -Wformat-security -D_FORTIFY_SOURCE=2 -fno-strict-overflow -fno-delete-null-pointer-checks -fwrapv -fstack-protector-strong -s -ffile-prefix-map=/__w/openvino/openvino/openvino/= -ffile-prefix-map=../openvino/= -Wl,--exclude-libs,ALL -Wl,--gc-sections -pie -z noexecstack -z relro -z now docs/snippets/CMakeFiles/ov_integration_snippet.dir/src/main.cpp.o -o /__w/openvino/openvino/openvino/bin/riscv64/Release/ov_integration_snippet /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_auto_plugin.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_auto_batch_plugin.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_hetero_plugin.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_riscv_cpu_plugin.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_template_plugin.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_ir_frontend.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_onnx_frontend.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_pytorch_frontend.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_tensorflow_frontend.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_tensorflow_lite_frontend.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_paddle_frontend.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_snippets.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_interpreter_backend.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libov_builders.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_onnx_common.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_auto_plugin.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_auto_batch_plugin.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_hetero_plugin.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_riscv_cpu_plugin.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_template_plugin.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_ir_frontend.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_onnx_frontend.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_pytorch_frontend.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_tensorflow_frontend.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_tensorflow_lite_frontend.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_paddle_frontend.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_snippets.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_interpreter_backend.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libov_builders.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_onnx_common.a -latomic /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_onednn_cpu.a /github/home/.conan2/p/b/snapp4fc06e380b298/p/lib/libsnappy.a -lstdc++ /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_tensorflow_common.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_reference.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_itt.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_shape_inference.a /__w/openvino/openvino/openvino/bin/riscv64/Release/libopenvino_util.a /github/home/.conan2/p/b/pugixcd82c05603ba9/p/lib/libpugixml.a -ldl /github/home/.conan2/p/b/onnx941a88db60a54/p/lib/libonnx.a /github/home/.conan2/p/b/onnx941a88db60a54/p/lib/libonnx_proto.a /github/home/.conan2/p/b/protofcdbf08a6f361/p/lib/libprotobuf.a -lm -lpthread && :across the build logs with different hashes? They differ from build to build. Could they be the problem that triggers the server shutdown and rebuild?