search

conda-forge / conda-forge.github.io

The conda-forge website.
https://conda-forge.org
BSD 3-Clause "New" or "Revised" License
131 stars 274 forks source link

Procuring more macOS workers #306

Closed wesm closed 6 years ago

wesm commented 7 years ago

Hello -- what is the current status vis-a-vis OS X build capacity for CF? I opened a build a little over 4 hours ago and it still hasn't processed: https://github.com/conda-forge/parquet-cpp-feedstock/pull/10

By the time that's merged, then master builds, we could be talking 12-24 hour turnaround time to update a package only requiring a change in build and version number.

What's the status of fiscal sponsorship for CF and Travis CI in particular? Can I help with procuring funds to obtain more workers? Have you considered joining NumFOCUS to provide another conduit of tax-deductible donations? We should also put a big blue DONATE button on the conda-forge homepage (but we would need a legal entity set up to collect the donations).

I'm willing to invest a bunch of my energy in helping fund raise because of the amount of time this has been costing me, so let me know how I can help.

ocefpaf commented 7 years ago

Anything the rest of us can to help?

At the moment there is not much we can do. I'm trying to go to PyData NY in November to see if I can talk with NumFOCUS people in person and move this faster.

mwcraig commented 6 years ago

GIving this issue a bump now that conda-forge is a NumFocus affiliated package: https://www.numfocus.org/sponsored-projects/affiliated-projects/

In addition to the travis plan above, circle-ci also offers mac options: http://circleci.com/pricing/#build-os-x

jakirkham commented 6 years ago

Thanks @mwcraig. Have updated the title to reflect the new scope.

johanneskoester commented 6 years ago

Dear all, I would like to inform you that we had the same issues in bioconda, and we now have switched to CircleCI for both Linux and MacOS. We simply asked them and they gave us free builds on both. Maybe that is an option for you as well?

mwcraig commented 6 years ago

@johanneskoester -- thanks for the additional information. Do you have a cap on your mac build minutes per month?

jakirkham commented 6 years ago

Going to close this out for a few reasons.

First, today Travis CI's macOS builds are run faster than any other CI (including our Dockerized Linux builds on CircleCI surprisingly) even while we are under the strain of a nearly total stack rebuild while continuing to maintain a stable copy of packages alongside it (basically doubling our job queue). IOW if any CI is struggling it is definitely not Travis CI. This is a pretty big improvement and a lot of this thanks to how Travis CI redesigned their macOS offering earlier this year, for which we are very thankful.

Second, as many of you know, conda-forge recently became a NumFOCUS sponsored project. As such NumFOCUS is able to receive donations on our behalf (amongst many other great things NumFOCUS does). So it is actually possible to donate to conda-forge, which was not previously possible. Hence we have a way of getting funds that can be spent on CI.

Third we received our first donation, which core has decide will be spent on more AppVeyor jobs (the currently hampered build queue). So what was once a nearly insurmountable obstacle is much more easily resolvable today (as long as we have the funds of course).

We have come a long way and we are very thankful for everyone that helped make this possible. 😄