search

Archiconda / build-tools

necessary build tools for the archiconda distribution
BSD 2-Clause "Simplified" License
283 stars 50 forks source link

Optimized python builds #14

Open hmaarrfk opened 5 years ago

hmaarrfk commented 5 years ago

@jjhelmus my optimzied python builds timed out.

https://app.shippable.com/github/Archiconda/python-feedstock/dashboard

I'm also unsure about doing the Optimization on a CI. Seems a little spooky especially since this CI has a 96 core machine!!!!

I assume they have dual cravium processors https://www.marvell.com/server-processors/thunderx-arm-processors/

Do you want to run the builds on your hardware?

jjhelmus commented 5 years ago

I built an optimized version of Python 3.7.2 on my hardware which took a little over 2 hours. Most of the PGO must be done single threaded so having more cores does not speed up the build. The package can be found in the c4aarch64 channel.

The recipe is available in the conda4aarch repo. It tracks the version from the AnacondaRecipes feedstock which has a few minor difference from the conda-forge recipe.

hmaarrfk commented 5 years ago

Nice!!! It will be cool to benchmark the difference that it has on real applications.