search

conda-forge / kfp-feedstock

A conda-smithy repository for kfp.
BSD 3-Clause "New" or "Revised" License
3 stars 10 forks source link

Missing kfp-kubernetes #103

Open therc opened 2 months ago

therc commented 2 months ago

Solution to issue cannot be found in the documentation.

Issue

In V2, kubeflow-pipelines has moved Kubernetes-specific features to a kfp-kubernetes package. It doesn't look like it's packaged in kfp. Upstream, it's located in a subdirectory of its own: https://github.com/kubeflow/pipelines/tree/master/kubernetes_platform/python/kfp/kubernetes

There is a kfp-kubernetes pip package. I can see three ways to offer the functionality:

  1. punt to the PyPI package
  2. release a separate kfp-kubernetes subpackage in lockstep with kfp
  3. just include it in the main kfp packages (as kfp.kubernetes)

Installed packages

_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       2_gnu    conda-forge
aiohappyeyeballs          2.3.5              pyhd8ed1ab_0    conda-forge
aiohttp                   3.10.3          py310h5b4e0ec_0    conda-forge
aiosignal                 1.3.1              pyhd8ed1ab_0    conda-forge
archspec                  0.2.3              pyhd8ed1ab_0    conda-forge
async-timeout             4.0.3              pyhd8ed1ab_0    conda-forge
attrs                     24.2.0             pyh71513ae_0    conda-forge
blinker                   1.8.2              pyhd8ed1ab_0    conda-forge
boltons                   24.0.0             pyhd8ed1ab_0    conda-forge
brotli-python             1.1.0           py310hc6cd4ac_1    conda-forge
bzip2                     1.0.8                h4bc722e_7    conda-forge
c-ares                    1.33.0               ha66036c_0    conda-forge
ca-certificates           2024.7.4             hbcca054_0    conda-forge
cachetools                5.4.0              pyhd8ed1ab_0    conda-forge
certifi                   2024.7.4           pyhd8ed1ab_0    conda-forge
cffi                      1.17.0          py310h2fdcea3_0    conda-forge
charset-normalizer        3.3.2              pyhd8ed1ab_0    conda-forge
click                     8.1.7           unix_pyh707e725_0    conda-forge
colorama                  0.4.6              pyhd8ed1ab_0    conda-forge
conda                     24.7.1          py310hff52083_0    conda-forge
conda-content-trust       0.2.0           py310h06a4308_0  
conda-libmamba-solver     23.12.0            pyhd3eb1b0_1  
conda-package-handling    2.3.0              pyh7900ff3_0    conda-forge
conda-package-streaming   0.10.0             pyhd8ed1ab_0    conda-forge
cryptography              43.0.0          py310h4909e49_0    conda-forge
distro                    1.9.0              pyhd8ed1ab_0    conda-forge
docstring_parser          0.16               pyhd8ed1ab_0    conda-forge
fmt                       9.1.0                h924138e_0    conda-forge
frozendict                2.4.2           py310h5eee18b_0  
frozenlist                1.4.1           py310h2372a71_0    conda-forge
google-api-core           2.19.1             pyhd8ed1ab_0    conda-forge
google-auth               2.33.0             pyhff2d567_0    conda-forge
google-cloud-core         2.4.1              pyhd8ed1ab_0    conda-forge
google-cloud-storage      2.18.2             pyhff2d567_0    conda-forge
google-crc32c             1.5.0                    pypi_0    pypi
google-resumable-media    2.7.2              pyhd8ed1ab_1    conda-forge
googleapis-common-protos  1.63.2             pyhd8ed1ab_0    conda-forge
grpcio                    1.62.2          py310h6a678d5_0  
h2                        4.1.0              pyhd8ed1ab_0    conda-forge
hpack                     4.0.0              pyh9f0ad1d_0    conda-forge
hyperframe                6.0.1              pyhd8ed1ab_0    conda-forge
icu                       73.2                 h59595ed_0    conda-forge
idna                      3.7                pyhd8ed1ab_0    conda-forge
jsonpatch                 1.33               pyhd8ed1ab_0    conda-forge
jsonpointer               3.0.0           py310hff52083_0    conda-forge
keyutils                  1.6.1                h166bdaf_0    conda-forge
kfp                       2.8.0              pyhd8ed1ab_0    conda-forge
kfp-pipeline-spec         0.3.0              pyhd8ed1ab_0    conda-forge
kfp-server-api            2.0.5                    pypi_0    pypi
krb5                      1.20.1               h81ceb04_0    conda-forge
ld_impl_linux-64          2.40                 hf3520f5_7    conda-forge
libabseil                 20240116.2      cxx17_he02047a_1    conda-forge
libarchive                3.6.2                hfab0078_4  
libcrc32c                 1.1.2                h9c3ff4c_0    conda-forge
libcurl                   8.7.1                h251f7ec_0  
libedit                   3.1.20191231         he28a2e2_2    conda-forge
libev                     4.33                 hd590300_2    conda-forge
libffi                    3.4.2                h7f98852_5    conda-forge
libgcc-ng                 14.1.0               h77fa898_0    conda-forge
libgomp                   14.1.0               h77fa898_0    conda-forge
libgrpc                   1.62.2               h2d74bed_0  
libmamba                  1.5.8                hfe524e5_2  
libmambapy                1.5.8           py310h2dafd23_2  
libnghttp2                1.57.0               h2d74bed_0  
libprotobuf               4.25.3               he621ea3_0  
libsolv                   0.7.24               he621ea3_1  
libssh2                   1.10.0               ha35d2d1_2    conda-forge
libstdcxx-ng              14.1.0               hc0a3c3a_0    conda-forge
libuuid                   1.41.5               h5eee18b_0  
libxml2                   2.13.1               hfdd30dd_2  
lz4-c                     1.9.4                hcb278e6_0    conda-forge
menuinst                  2.0.1           py310h06a4308_1  
multidict                 6.0.5           py310h2372a71_0    conda-forge
ncurses                   6.5                  h59595ed_0    conda-forge
oauthlib                  3.2.2              pyhd8ed1ab_0    conda-forge
openssl                   3.3.1                h4bc722e_2    conda-forge
packaging                 24.1               pyhd8ed1ab_0    conda-forge
pcre2                     10.42                hebb0a14_1  
pip                       23.3.1          py310h06a4308_0  
platformdirs              4.2.2              pyhd8ed1ab_0    conda-forge
pluggy                    1.5.0              pyhd8ed1ab_0    conda-forge
proto-plus                1.24.0                   pypi_0    pypi
protobuf                  4.25.4                   pypi_0    pypi
pyasn1                    0.6.0              pyhd8ed1ab_0    conda-forge
pyasn1-modules            0.4.0              pyhd8ed1ab_0    conda-forge
pybind11-abi              4                    hd8ed1ab_3    conda-forge
pycosat                   0.6.6           py310h2372a71_0    conda-forge
pycparser                 2.22               pyhd8ed1ab_0    conda-forge
pyjwt                     2.9.0              pyhd8ed1ab_1    conda-forge
pyopenssl                 24.2.1             pyhd8ed1ab_2    conda-forge
pysocks                   1.7.1              pyha2e5f31_6    conda-forge
python                    3.10.13              h955ad1f_0  
python-dateutil           2.9.0.post0              pypi_0    pypi
python-kubernetes         26.1.0             pyhd8ed1ab_0    conda-forge
python_abi                3.10                    2_cp310    conda-forge
pyu2f                     0.1.5              pyhd8ed1ab_0    conda-forge
pyyaml                    6.0.2           py310h5b4e0ec_0    conda-forge
re2                       2022.04.01           h27087fc_0    conda-forge
readline                  8.2                  h8228510_1    conda-forge
reproc                    14.2.4.post0         hd590300_1    conda-forge
reproc-cpp                14.2.4.post0         h59595ed_1    conda-forge
requests                  2.32.3             pyhd8ed1ab_0    conda-forge
requests-oauthlib         2.0.0              pyhd8ed1ab_0    conda-forge
requests-toolbelt         0.10.1             pyhd8ed1ab_0    conda-forge
rsa                       4.9                pyhd8ed1ab_0    conda-forge
ruamel.yaml               0.18.6          py310h2372a71_0    conda-forge
ruamel.yaml.clib          0.2.8           py310h2372a71_0    conda-forge
setuptools                68.2.2          py310h06a4308_0  
six                       1.16.0             pyh6c4a22f_0    conda-forge
sqlite                    3.45.3               h5eee18b_0  
tabulate                  0.9.0              pyhd8ed1ab_1    conda-forge
tk                        8.6.14               h39e8969_0  
tqdm                      4.66.5             pyhd8ed1ab_0    conda-forge
truststore                0.8.0              pyhd8ed1ab_0    conda-forge
typing-extensions         4.12.2               hd8ed1ab_0    conda-forge
typing_extensions         4.12.2             pyha770c72_0    conda-forge
tzdata                    2024a                h0c530f3_0    conda-forge
urllib3                   1.26.19            pyhd8ed1ab_0    conda-forge
websocket-client          1.8.0              pyhd8ed1ab_0    conda-forge
wheel                     0.41.2          py310h06a4308_0  
xz                        5.4.6                h5eee18b_1  
yaml                      0.2.5                h7f98852_2    conda-forge
yaml-cpp                  0.8.0                h59595ed_0    conda-forge
yarl                      1.9.4           py310h2372a71_0    conda-forge
zlib                      1.2.13               h5eee18b_1  
zstandard                 0.22.0          py310h1275a96_0    conda-forge
zstd                      1.5.5                hc292b87_2

Environment info

active environment : base
    active env location : /home/rudi/miniconda3
            shell level : 1
       user config file : /home/rudi/.condarc
 populated config files : /home/rudi/.condarc
          conda version : 24.7.1
    conda-build version : not installed
         python version : 3.10.13.final.0
                 solver : classic
       virtual packages : __archspec=1=icelake
                          __conda=24.7.1=0
                          __glibc=2.38=0
                          __linux=6.9.11=0
                          __unix=0=0
       base environment : /home/rudi/miniconda3  (writable)
      conda av data dir : /home/rudi/miniconda3/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/rudi/miniconda3/pkgs
                          /home/rudi/.conda/pkgs
       envs directories : /home/rudi/miniconda3/envs
                          /home/rudi/.conda/envs
               platform : linux-64
             user-agent : conda/24.7.1 requests/2.32.3 CPython/3.10.13 Linux/6.9.11-100.fc39.x86_64 fedora/39 glibc/2.38
                UID:GID : 1000:1000
             netrc file : None
           offline mode : False
therc commented 2 months ago

In case you're wondering, this is to set up things such as node selector labels, pod labels, ephemeral volumes and ports. See https://www.kubeflow.org/docs/components/pipelines/user-guides/core-functions/platform-specific-features/