search

apache / openwhisk

Apache OpenWhisk is an open source serverless cloud platform
https://openwhisk.apache.org/
Apache License 2.0
6.54k stars 1.17k forks source link

Add new python kind with pandas and numpy in the environment #2300

Closed rabbah closed 6 years ago

rabbah commented 7 years ago

The ability to add a new runtime per deployment was improved with the introduction of a runtimes manifest. The motivation for this is to add more runtimes that may be of interest based on usage.

The way I was thinking of doing is is another "blackbox" supported image like the openwhisk skeleton. To enable this, we'd need to programmatically pull the curated docker images to the invoker registries.

leetabix commented 7 years ago

Hi Rodric, I was pointed towards this issue by Kailash Peri as a result of a ticket I raised (#5377-13398691) relating to exceeding the size of a Docker environment for a Python action using Pandas (itself dependant on NumPy). Happy to share any details or collaborate if you need any assistance.

I believe your comment is referring to adding NumPy/Pandas to the list of packages which can be called without needing to create a Docker environment that includes the extra packages. If so, then I wholeheartedly support this approach as it'd make OpenWhisk far more accessible to these very popular data science packages.

Many thanks, James Johnson (fellow IBMer posting on my personal GitHub account)

rabbah commented 6 years ago

Closing as this can be a deployment specific image. IBM Cloud Functions will roll out a new python image with additional python packages: https://github.com/ibm-functions/runtime-python/commit/d9bcbddc38da1e33e112ebfa5ba3875d9634ade8

rabbah commented 6 years ago

@csantanapr FYI.

leetabix commented 6 years ago

Thanks rabbah, that's great news!