search

CONABIO / kube_sipecam

k8s processing documentation for SiPeCaM project
MIT License
0 stars 1 forks source link

Choose tfx docker image as base image for audio processing kubeflow pipelines #5

Open palmoreck opened 4 years ago

palmoreck commented 4 years ago

If using Docker image 0.21.4 as base image, next output is obtained:

2020-04-24 17:41:30.028801: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libnvinfer.so.6'; dlerror: libnvinfer.so.6: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /usr/local/lib
2020-04-24 17:41:30.029009: W tensorflow/stream_executor/platform/default/dso_loader.cc:55] Could not load dynamic library 'libnvinfer_plugin.so.6'; dlerror: libnvinfer_plugin.so.6: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /usr/local/lib
2020-04-24 17:41:30.029035: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:30] Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
usage: run_executor.py [-h] --executor_class_path EXECUTOR_CLASS_PATH
                       [--temp_directory_path TEMP_DIRECTORY_PATH]
                       (--inputs INPUTS | --inputs-base64 INPUTS_BASE64)
                       (--outputs OUTPUTS | --outputs-base64 OUTPUTS_BASE64)
                       (--exec-properties EXEC_PROPERTIES | --exec-properties-base64 EXEC_PROPERTIES_BASE64)
                       [--write-outputs-stdout]
run_executor.py: error: the following arguments are required: --executor_class_path

If Docker image tfx base is used as base image, next output is obtained:

Extracting Bazel installation...
                                                           [bazel release 3.0.0]
Usage: bazel <command> <options> ...

Available commands:
  analyze-profile     Analyzes build profile data.
  aquery              Analyzes the given targets and queries the action graph.
  build               Builds the specified targets.
  canonicalize-flags  Canonicalizes a list of bazel options.
  clean               Removes output files and optionally stops the server.
  coverage            Generates code coverage report for specified test targets.
...
Getting more help:
  bazel help <command>
                   Prints help and options for <command>.
  bazel help startup_options
                   Options for the JVM hosting bazel.
  bazel help target-syntax
                   Explains the syntax for specifying targets.
  bazel help info-keys
                   Displays a list of keys used by the info command.

Need to choose which tfx base docker image will use in audio processing kubeflow pipelines

See:

tfx Dockerfile

mnist pipeline native keras

taxi pipeline simple