break the posix build into stages

[mattip]

Checklist

• [x] Used a personal fork of the feedstock to propose changes
• [x] Bumped the build number (if the version is unchanged)
• [ ] Reset the build number to 0 (if the version changed)
• [ ] Re-rendered with the latest conda-smithy (Use the phrase code>@<space/conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
• [ ] Ensured the license file is being packaged.

At the end of translation, PyPy by default builds the cffi import libraries using --embed-dependencies, which is wrong for conda. It also swallows the output for the final stages, which makes debugging CI more difficult.

By adding the --no-compile option, the translation will stop before calling make, which is the last option to terminate traslation. Maybe someday PyPy will grow an option to only skip the cffi build stage, which is complicated for ... reasons. So the PR adds the option, then dives into the emitted source directory, calls make, and copies out the artifacts.

Commands to continue from there were already in the build.sh script, but I added pre-building the c-extension modules to avoid race conditions when building them in multi-threaded tests. Maybe I should disable the stdlib tests, they take a long time?

xref #40

[conda-forge-linter]

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

[mattip]

@conda-forge-admin, please rerender

[mattip]

I see there is a problem with macOS, I will push a fix. But before I waste another CI build cycle, is there something that needs to happen so that distutils.ccompiler works on linux? The linepypy3 -c "import _testcapi" tries to call

    from distutils.ccompiler import new_compiler
    from distutils import log
    log.set_verbosity(3)

    compiler = new_compiler()
    compiler.output_dir = output_dir
    # Compile .c file
    include_dir = os.path.join(thisdir, '..', 'include')
    if sys.platform == 'win32':
        ccflags = ['-D_CRT_SECURE_NO_WARNINGS']
    else:
        ccflags = ['-fPIC', '-Wimplicit-function-declaration']
    res = compiler.compile([os.path.join(thisdir, csource)],
                           include_dirs=[include_dir],
                           extra_preargs=ccflags,
                          )

and fails with

cc -fPIC -Wimplicit-function-declaration -I$PREFIX/lib_pypy/../include -c $PREFIX/lib_pypy/_testcapimodule.c -o /tmp/testcapi_d96dc44b6b6ae973$PREFIX/lib_pypy/_testcapimodule.o
unable to execute 'cc': No such file or directory

[isuruf]

Yes, you need to call distutils.sysconfig.customize_compiler(compiler) before running .compile

[mattip]

thanks

[isuruf]

Thanks

[mattip]

let me know how the aarch64 build goes

[isuruf]

Build went fine, but at conda-build packaging step I got the error OSError: [Errno 26] Text file busy: $PREFIX/bin/pypy3. Re-running now.

[mattip]

Hmm, that sounds like a problem with either symlinks or some strange file ownership problems?