rust-lang / rustc-dev-guide

A guide to how rustc works and how to contribute to it.
https://rustc-dev-guide.rust-lang.org
Apache License 2.0
1.66k stars 514 forks source link

Document how to build rustc under the same conditions as in CI #447

Open gnzlbg opened 5 years ago

gnzlbg commented 5 years ago

Sometimes the CI build fails, and when one tries running it locally, it succeeds.

@mati865 mentions here that one can build locally on linux under the same conditions as CI by doing:

DEPLOY=1 ./src/ci/docker/run.sh dist-x86_64-linux.

This other user had to use this instead:

#!/bin/bash

# Clean up from previous build
rm -rf build

# Configuration which is always enabled
export RUST_RELEASE_CHANNEL=nightly
RUST_CONFIGURE_ARGS="$RUST_CONFIGURE_ARGS --enable-sccache"
RUST_CONFIGURE_ARGS="$RUST_CONFIGURE_ARGS --disable-manage-submodules"
RUST_CONFIGURE_ARGS="$RUST_CONFIGURE_ARGS --enable-locked-deps"
RUST_CONFIGURE_ARGS="$RUST_CONFIGURE_ARGS --enable-cargo-native-static"
RUST_CONFIGURE_ARGS="$RUST_CONFIGURE_ARGS --set rust.codegen-units-std=1"

# Deploy configuration
RUST_CONFIGURE_ARGS="$RUST_CONFIGURE_ARGS --release-channel=$RUST_RELEASE_CHANNEL"
RUST_CONFIGURE_ARGS="$RUST_CONFIGURE_ARGS --enable-llvm-static-stdcpp"
RUST_CONFIGURE_ARGS="$RUST_CONFIGURE_ARGS --set rust.remap-debuginfo"
RUST_CONFIGURE_ARGS="$RUST_CONFIGURE_ARGS --debuginfo-level-std=1"

RUST_CONFIGURE_ARGS="$RUST_CONFIGURE_ARGS --enable-llvm-assertions"
RUST_CONFIGURE_ARGS="$RUST_CONFIGURE_ARGS --set rust.verify-llvm-ir"

RUST_CONFIGURE_ARGS="$RUST_CONFIGURE_ARGS --enable-debug-assertions"
RUST_CONFIGURE_ARGS="$RUST_CONFIGURE_ARGS --set rust.jemalloc"

# Configure and make
./configure $RUST_CONFIGURE_ARGS
make -j $(nproc)

we should document exactly how to try to reproduce a CI failure locally inside docker, and then how to try to reproduce it outside docker but still using all other options that are set in CI but not by default (like using jemalloc instead of the system allocator).

This information should be complemented with a fix to #443 that explains how to attach a debugger on these scenarios.

jieyouxu commented 1 week ago

Triage: the linux CI jobs have docker images which make those easy, but Tier 2 failures and non-Linux (e.g. macOS, apple, windows) CI job failures still make this problematic.

jieyouxu commented 1 week ago

cc #t-infra thread https://rust-lang.zulipchat.com/#narrow/channel/242791-t-infra/topic/Suggestion.3A.20better.20docs.20for.20what.20each.20CI.20jobs.20do