Open AdeloreSimiloluwa opened 3 years ago
before the pods got error out try to check the logs "kubectl logs -f pyspark-pi-driver". i think you haven't supply the argument
before the pods got error out try to check the logs "kubectl logs -f pyspark-pi-driver". i think you haven't supply the argument
yeah i tried to get the logs and here is the output from kubectl logs -f pyspark-pi-driver
error: a container name must be specified for pod pyspark-pi-driver, choose one of: [spark-kubernetes-driver istio-proxy] or one of the init containers: [istio-init]
@luciferksh
Hi @AdeloreSimiloluwa, there seems to be some sidecar container running(istio-proxy). You have to specify the container name (-c is the option to select container) whenever you have more than one container running in a pod.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
Trying to run a spark operator, i am using the
pi.py
file andspark-py-pi.yaml
filesand here is the yaml file as well