Jittor / jittor

Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.
https://cg.cs.tsinghua.edu.cn/jittor/
Apache License 2.0
3.08k stars 311 forks source link

Jittor docker Failed #150

Open mingzailao opened 4 years ago

mingzailao commented 4 years ago
docker pull jittor/jittor-cuda-10-1:latest
(or)docker pull jittor/jittor-cida:latest

When I Use Jittor in Container,

ipython
import jittor

Output:

In [1]: import jittor                                                                  
[i 1019 04:34:41.702875 28 __init__.py:238] Found g++(7.4.0) at /usr/bin/g++.
[i 1019 04:34:41.728368 44 __init__.py:238] Found /usr/local/cuda/bin/nvcc(10.1.243) at /usr/local/cuda/bin/nvcc.
[i 1019 04:34:41.761501 44 __init__.py:238] Found addr2line(2.30) at /usr/bin/addr2line.
[i 1019 04:34:41.801923 44 compiler.py:879] pybind_include: -I/usr/include/python3.7m -I/usr/local/lib/python3.7/dist-packages/pybind11/include
[i 1019 04:34:41.830459 44 compiler.py:881] extension_suffix: .cpython-37m-x86_64-linux-gnu.so
[i 1019 04:34:42.206687 44 __init__.py:158] Total mem: 125.59GB, using 16 procs for compiling.
Compiling jittor_core(134/134) used: 22.905s eta: 0.000s
[i 1019 04:35:05.580217 44 jit_compiler.cc:20] Load cc_path: /usr/bin/g++
[i 1019 04:35:05.582801 44 init.cc:51] Found cuda archs: [75,]
[i 1019 04:35:05.789601 44 __init__.py:238] Found mpicc(2.1.1) at /usr/bin/mpicc.
[i 1019 04:35:05.826498 44 compiler.py:638] handle pyjt_include/usr/local/lib/python3.7/dist-packages/jittor/extern/mpi/inc/mpi_warper.h
[i 1019 04:35:07.973487 44 compile_extern.py:258] Downloading nccl...
Data file has been downloaded and verified
Compiling gen_ops_mkl_conv_backward_x_mkl_test_mkl_matmul_mkl_conv_mkl_conv_backward_w(7/7) used: 2.471s eta: 0.000s
Compiling cuda_extern(3/3) used: 2.030s eta: 0.000s
[i 1019 04:35:16.529606 44 compile_extern.py:15] found /usr/include/cublas.h
[i 1019 04:35:16.529690 44 compile_extern.py:15] found /usr/lib/x86_64-linux-gnu/libcublas.so
terminate called after throwing an instance of 'std::runtime_error'
  what():  [f 1019 04:35:18.570274 44 helper_cuda.h:120] CUDA error at /usr/local/lib/python3.7/dist-packages/jittor/extern/cuda/cublas/src/cublas_warper.cc:20  code=1( CUBLAS_STATUS_NOT_INITIALIZED ) cublasCreate(&cublas_handle)
Aborted (core dumped)

There Is The Image Info:

root@jittor:/usr/src/jittor# nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2019 NVIDIA Corporation
Built on Sun_Jul_28_19:07:16_PDT_2019
Cuda compilation tools, release 10.1, V10.1.243
cjld commented 4 years ago

Hello, thanks for reporting this issue, we cannot reproduce this issue, could you please provide more information, such as nvidia-smi

here is a screenshot of the similar commands: ![Uploading image.png…]()

cjld commented 4 years ago

Hello, thanks for reporting this issue, we cannot reproduce this issue, could you please provide more information, such as nvidia-smi

here is a screenshot of the similar commands: image