waymo-research / waymo-open-dataset

Waymo Open Dataset
https://www.waymo.com/open
Other
2.74k stars 621 forks source link

`waymo-open-dataset-tf-2-12-0` cannot install under Python 3.11 #868

Open kylevedder opened 3 months ago

kylevedder commented 3 months ago

Under Python 3.11, installation of pip install waymo-open-dataset-tf-2.12.0 fails due to pegged numpy version and downstream requirements numpy versions:

11.34 The conflict is caused by:
11.34     waymo-open-dataset-tf-2-12-0 1.6.2 depends on numpy==1.23
11.34     dask[dataframe] 2023.3.1 depends on numpy>=1.21; extra == "dataframe"
11.34     matplotlib 3.6.1 depends on numpy>=1.19
11.34     pandas 1.5.3 depends on numpy>=1.21.0; python_version >= "3.10"
11.34     pandas 1.5.3 depends on numpy>=1.23.2; python_version >= "3.11"

Full docker container to reporduce this issue:

FROM nvidia/cudagl:11.3.0-devel-ubuntu20.04
SHELL ["/bin/bash", "-c"]
RUN ln -snf /usr/share/zoneinfo/America/New_York /etc/localtime && echo "/usr/share/zoneinfo/America/New_York" > /etc/timezone

# Core system packages
RUN apt-get update --fix-missing
RUN apt install -y software-properties-common wget curl gpg gcc git make

# Install miniconda to /miniconda
RUN curl -LO http://repo.continuum.io/miniconda/Miniconda3-latest-Linux-x86_64.sh
RUN bash Miniconda3-latest-Linux-x86_64.sh -p /miniconda -b
RUN rm Miniconda3-latest-Linux-x86_64.sh
ENV PATH=/miniconda/bin:${PATH}
RUN conda update -y conda

RUN apt install -y apt-utils

ENV TORCH_CUDA_ARCH_LIST="Ampere;Turing;Pascal"
ENV FORCE_CUDA="1"
RUN conda update -y conda

RUN conda install python=3.11 pip -y
RUN pip install --upgrade pip
RUN pip install waymo-open-dataset-tf-2.12.0
daphnecor commented 3 months ago

I encountered difficulties with this version of the womd dataset as well but was able to get it to work with Python version 3.10.2.

See this Google Colab with a working import