Experimental features: run with external-environment and project archive download/extract

[AlbertDeFusco]

Two experimental features are added here

External environment

You can run commands using conda environments not managed by the project itself.

conda project run --external-environment=<env> [command] [args ...]

Where <env> can be a relative or absolute path to a conda environment, or the name of a global environment stored in one of envs_dirs directories.

If there is a collision between a local environment directory and named environment, the local environment directory is preferred.

If no local environment directory found it will check through the conda config "envs_dirs" in order and return the first matching named environment.

~In this PR a defined environment is not required.~

Download and extract a project archive

Two new flags are added --project-archive and --archive-storage-options

--project-archive PROJECT_ARCHIVE_FILE_OR_URL
                        EXPERIMENTAL: Extract and run directly from a project archive. The archive can be a local file or a
                        fsspec compatible URL. You may need to install appropriate driver packages to work with remote
                        archives. Optionally, use --directory to set the destination directory of the extracted project.
--archive-storage-options ARCHIVE_STORAGE_OPTIONS
                        EXPERIMENTAL: Comma separated list of fsspec storage_options for accessing a remote archive For example
                        --archive-storage-options username=<user>,password=<pass>

These flags are enabled for

• lock
• check
• install
• activate
• run

TODO:

• [x] error handling and messages
• [x] tests
• [ ] docs (maybe)

[AlbertDeFusco]

Added support for the currently activated env if a) the project has no defined environment and b) --external-environment is not supplied

[AlbertDeFusco]

Added support for the currently activated env if a) the project has no defined environment and b) --external-environment is not supplied

[AlbertDeFusco]

Updates:

• --project-archive <local-or-remote-archive supports local files or fsspec-compatible urls to automatically download and extract projects
  • the archive can be any format and compression supported by libarchive
• --directory combined with --project-archive will control the output project directory upon extraction, without the --directory parameter the project directly will be
  • the top-level directory in the archive
  • if no top-level directory is present the basename of the archive becomes the name of the project directory
• added --archive-storage-options <key>=<value>,<key>,<value>... is a comma separated list of fsspec storage_options parameters
• --project-archive works for check, install, lock, activate, and run
  • the project archive is extracted (see --directory) and the command is executed against the extracted project directory

for example

conda install defusco/label/dev::conda-project=0.2.0.dev2 aiohttp requests

conda-project run --project-archive https://anaconda.org/defusco/project/windturbines/download jupyter notebook wind-turbines.ipynb

[codecov[bot]]

Codecov Report

Merging #106 (e2c10b3) into main (a3e84f1) will increase coverage by 1.04%. The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main     #106      +/-   ##
==========================================
+ Coverage   96.63%   97.67%   +1.04%     
==========================================
  Files           9        9              
  Lines         742      818      +76     
==========================================
+ Hits          717      799      +82     
+ Misses         25       19       -6     

Impacted Files	Coverage Δ
src/conda_project/cli/commands.py	100.00% <100.00%> (ø)
src/conda_project/cli/main.py	100.00% <100.00%> (ø)
src/conda_project/conda.py	82.10% <100.00%> (+7.94%)	:arrow_up:
src/conda_project/project.py	100.00% <100.00%> (ø)
src/conda_project/utils.py	100.00% <100.00%> (ø)

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more