search

intel-analytics / analytics-zoo

Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray
https://analytics-zoo.readthedocs.io/
Apache License 2.0
11 stars 3 forks source link

jenkins: cannot import name 'KafkaProducer'(only mac) #25

Closed pinggao187 closed 2 years ago

pinggao187 commented 2 years ago 

==================================== ERRORS ====================================
_____________ ERROR collecting zoo/serving/kafka/kafka_example.py ______________
../zoo/serving/kafka/kafka_example.py:17: in <module>
    from kafka import KafkaProducer, KafkaConsumer
E   ImportError: cannot import name 'KafkaProducer'
=============================== warnings summary ===============================
/opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/py4j-0.10.7-src.zip/py4j/java_gateway.py:2020
/opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/py4j-0.10.7-src.zip/py4j/java_gateway.py:2020
  /opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/py4j-0.10.7-src.zip/py4j/java_gateway.py:2020: DeprecationWarning: invalid escape sequence \*

/opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/sql/readwriter.py:369
/opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/sql/readwriter.py:369
  /opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/sql/readwriter.py:369: DeprecationWarning: invalid escape sequence \`

/opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/sql/readwriter.py:706
/opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/sql/readwriter.py:706
  /opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/sql/readwriter.py:706: DeprecationWarning: invalid escape sequence \`

/opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/sql/streaming.py:623
/opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/sql/streaming.py:623
  /opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/sql/streaming.py:623: DeprecationWarning: invalid escape sequence \`

/opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/sql/functions.py:1478
/opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/sql/functions.py:1478
  /opt/work/spark-2.1.3-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/sql/functions.py:1478: DeprecationWarning: invalid escape sequence \d

/private/var/jenkins_home/workspace/ZOO-NB-UnitTests-2.1-PYTHON-MAC/pyzoo/zoo/orca/common.py:101
  /private/var/jenkins_home/workspace/ZOO-NB-UnitTests-2.1-PYTHON-MAC/pyzoo/zoo/orca/common.py:101: DeprecationWarning: invalid escape sequence \d
    assert value == "DRAM" or value == "PMEM" or re.match("DISK_\d+", value), \

/private/var/jenkins_home/workspace/ZOO-NB-UnitTests-2.1-PYTHON-MAC/zoo/python_packages/sources/bigdl/nn/layer.py:830
  /private/var/jenkins_home/workspace/ZOO-NB-UnitTests-2.1-PYTHON-MAC/zoo/python_packages/sources/bigdl/nn/layer.py:830: DeprecationWarning: invalid escape sequence \w
    """

/private/var/jenkins_home/workspace/ZOO-NB-UnitTests-2.1-PYTHON-MAC/zoo/python_packages/sources/bigdl/nn/criterion.py:175
  /private/var/jenkins_home/workspace/ZOO-NB-UnitTests-2.1-PYTHON-MAC/zoo/python_packages/sources/bigdl/nn/criterion.py:175: DeprecationWarning: invalid escape sequence \s
    '''

/private/var/jenkins_home/workspace/ZOO-NB-UnitTests-2.1-PYTHON-MAC/zoo/python_packages/sources/bigdl/nn/criterion.py:535
  /private/var/jenkins_home/workspace/ZOO-NB-UnitTests-2.1-PYTHON-MAC/zoo/python_packages/sources/bigdl/nn/criterion.py:535: DeprecationWarning: invalid escape sequence \s
    '''

/private/var/jenkins_home/workspace/ZOO-NB-UnitTests-2.1-PYTHON-MAC/zoo/python_packages/sources/bigdl/nn/criterion.py:562
  /private/var/jenkins_home/workspace/ZOO-NB-UnitTests-2.1-PYTHON-MAC/zoo/python_packages/sources/bigdl/nn/criterion.py:562: DeprecationWarning: invalid escape sequence \s
    '''

/private/var/jenkins_home/workspace/ZOO-NB-UnitTests-2.1-PYTHON-MAC/pyzoo/zoo/pipeline/api/torch/torch_model.py:82
  /private/var/jenkins_home/workspace/ZOO-NB-UnitTests-2.1-PYTHON-MAC/pyzoo/zoo/pipeline/api/torch/torch_model.py:82: SyntaxWarning: assertion is always true, perhaps remove parentheses?
    assert(len(new_weight) == 1, "TorchModel's weights should be one tensor")

/private/var/jenkins_home/workspace/ZOO-NB-UnitTests-2.1-PYTHON-MAC/pyzoo/zoo/pipeline/inference/inference_model.py:136
  /private/var/jenkins_home/workspace/ZOO-NB-UnitTests-2.1-PYTHON-MAC/pyzoo/zoo/pipeline/inference/inference_model.py:136: SyntaxWarning: assertion is always true, perhaps remove parentheses?
    assert(model_path, str)

/Users/arda/anaconda3/envs/py36/lib/python3.6/site-packages/tensorflow_core/python/pywrap_tensorflow_internal.py:15
  /Users/arda/anaconda3/envs/py36/lib/python3.6/site-packages/tensorflow_core/python/pywrap_tensorflow_internal.py:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    import imp

-- Docs: https://docs.pytest.org/en/latest/warnings.html
=========================== short test summary info ============================
ERROR ../zoo/serving/kafka/kafka_example.py - ImportError: cannot import name..

jenkins link: http://10.112.231.51:18888/job/ZOO-NB-UnitTests-2.1-PYTHON-MAC/460/console PR: Add kafka support intel-analytics/analytics-zoo#4155 @EvelynQiang @Litchilitchy pls have a look.

Litchilitchy commented 2 years ago

is kafka installed in python env on jenkins node?

pinggao187 commented 2 years ago

is kafka installed in python env on jenkins node?

I will install 'kafka' on the mac node, and rerun.

pinggao187 commented 2 years ago

pass http://10.112.231.51:18888/job/ZOO-NB-UnitTests-2.1-PYTHON-MAC/461/