search

mamba-org / mamba

The Fast Cross-Platform Package Manager
https://mamba.readthedocs.io
BSD 3-Clause "New" or "Revised" License
6.57k stars 343 forks source link

Faster/efficient alternative to conda build #3274

Closed digikar99 closed 2 months ago

digikar99 commented 2 months ago

I recently learned about micromamba. Tried it. Blazing fast compared to conda or miniconda! So, thanks a lot to the developers!

I was actually looking for a package manager for the Common Lisp ecosystem that could handle non-lisp dependencies. Conda seems promising. However, I'm disappointed with the slowness and memory requirements of conda build. The slowness particularly seems to arise from "Attempting to finalize metadata for XXX", and I'm guessing this is because repodata (or is there another term for these jsons?) in micromamba/pkgs/cache/ are huge files spanning 200+ MB. I'm using conda-forge. The runtime memory requirements approach 4GB which doesn't look good for a simple package.

But the slowness could be arising due to other steps too. So, I wonder if there are any ongoing efforts to build a faster/efficient alternative to conda build.

digikar99 commented 2 months ago

Found this and, subsequently, rattler-build!

wolfv commented 2 months ago

great! Let me know if you have any questions - we are also always on Discord to talk about rattler-build: https://discord.gg/kKV8ZxyzY4