search

terryzhao127 / tensorflow-windows-build-script

A script to automate building Tensorflow on Windows and solve some problems
GNU General Public License v3.0
103 stars 35 forks source link

some fatal error occured when build tf 1.13.1 #16

Closed ihuale closed 5 years ago

ihuale commented 5 years ago

hi,there i run this command as admin on vs2015 x64 cmd,when after clone repository i got an error: 

build.ps1 -BazelBuildParameters -BuildCppAPI -ReserveSource -ReserveVenv

that's my config

then, according i input this string for BazelBuildParameters: 

--config=opt --config=cuda --define=no_tensorflow_py_deps=true --copt=-nvcc_options=disable-warnings //tensorflow:libtensorflow_cc.so --verbose_failures

but i got an error:
error_invoke it means some error on build.ps1 line 173, after google, i changed line 173 into this: 

(Invoke-WebRequest https://github.com/tensorflow/tensorflow/commit/ec727016282383aacf9d26386b01f6bdbd65b14b.patch -UseBasicParsing).Content | git apply -v --ignore-space-change --ignore-white

(just add "-UseBasicParsing" after url)

after fixed this, i got another fatal error:
error_bazel_build_1 i use google, but i still found nothing useful to solve this problem
could you have some solution to solve this? if so,that's great thanks

terryzhao127 commented 5 years ago

@ihuale Try build Tensorflow v1.12.0, and let us know if that works.

@asbe Did you build libtensorlfow_cc.so of Tensorflow v1.13.1?

ihuale commented 5 years ago

@guikarist ok, i will try it

asbe commented 5 years ago

Have identical build string, but also tested with "monolithic". Working on minimal test using extracted dll - currently having some import issues. I'm on latest VS17 Pro - and run script under Powershell.

terryzhao127 commented 5 years ago

Have identical build string, but also tested with "monolithic". Working on minimal test using extracted dll - currently having some import issues. I'm on latest VS17 Pro - and run script under Powershell.

@asbe Are those issues symbol issues?

One way or another, you've succeeded building.

ihuale commented 5 years ago

Is it because of the problem with the cuda version? my cuda version is 10.1, and cudnn is 7.5 i tried build 1.12.0, but ,got this error:
error_bazel_build_1120

asbe commented 5 years ago

@guikarist Yes the issues are symbol issues. @ihuale For me script works with VS17Pro, CUDA 10.1, CUDNN 7.5 on a Windows 10

I will try to add to symbols patch file and see if it works as @Steroes suggests. By adding the exp-file to linker I quickly run into issues with Unicode (possibly related to https://github.com/tensorflow/tensorflow/commit/7e090f6a5412fd5f22b5b75ca7ae7844c3d025e9)

terryzhao127 commented 5 years ago

Several comments were deleted due to off topic.

ihuale commented 5 years ago

sorry take so long time to reply, the reason for the failure seems to be because I used vs2015
once i changed to vs2017,it runs fine
when my build completed i will told you the results
thanks all

terryzhao127 commented 5 years ago

BTW, 1.13.1 is now supported (theoretically).

ihuale commented 5 years ago

ee, I am always happy too fast...
error_bazel_build_2017 error_bazel_2017_2

ihuale commented 5 years ago

vs2017(as admin)+cuda10.1+cudnn7.5+bazel0.20 failed again
my step:

  1. input build.ps1 -BazelBuildParameters --verbose_failures -BuildCppAPI -ReserveSource -ReserveVenv on this project dir
  2. input --config=opt --config=cuda --define=no_tensorflow_py_deps=true --copt=-nvcc_options=disable-warnings //tensorflow:libtensorflow_cc.so for BazelBuildParameters
  3. select tf version 1(that's tf1.13.1)
    bazel_step_1
  4. select build operation:
    bazel_step_2
  5. waitting
ihuale commented 5 years ago

@guikarist Sorry to bother you again，but i'm failed again... is there somthing wrong in my step?

terryzhao127 commented 5 years ago

Never mind. What is the error output?

ihuale commented 5 years ago 
Preconfigured Bazel build configs. You can use any of the below by adding "--config=<>" to your build command. See .bazelrc for more details.
        --config=mkl            # Build with MKL support.
        --config=monolithic     # Config for mostly static monolithic build.
        --config=gdr            # Build with GDR support.
        --config=verbs          # Build with libverbs support.
        --config=ngraph         # Build with Intel nGraph support.
        --config=dynamic_kernels        # (Experimental) Build kernels into separate shared objects.
Preconfigured Bazel build configs to DISABLE default on features:
        --config=noaws          # Disable AWS S3 filesystem support.
        --config=nogcp          # Disable GCP support.
        --config=nohdfs         # Disable HDFS support.
        --config=noignite       # Disable Apacha Ignite support.
        --config=nokafka        # Disable Apache Kafka support.
        --config=nonccl         # Disable NVIDIA NCCL support.
WARNING: The following rc files are no longer being read, please transfer their contents or import their path into one of the standard rc files:
d:\myproject\tensorflow-windows-build-script-master\source/.bazelrc
Starting local Bazel server and connecting to it...
WARNING: The following configs were expanded more than once: [cuda]. For repeatable flags, repeats are counted twice and may lead to unexpected behavior.
WARNING: Option 'experimental_shortened_obj_file_path' is deprecated
INFO: Invocation ID: 599201e7-ab9d-44d5-be7c-f1a99a952e79
INFO: Analysed target //tensorflow:libtensorflow_cc.so (103 packages loaded, 8292 targets configured).
INFO: Found 1 target...
ERROR: C:/users/dell/_bazel_dell/7lybdmg5/external/com_google_absl/absl/numeric/BUILD.bazel:25:1: C++ compilation of rule '@com_google_absl//absl/numeric:int128' failed (Exit 2): python.exe failed: error executing command
  cd C:/users/dell/_bazel_dell/7lybdmg5/execroot/org_tensorflow
  SET CUDA_TOOLKIT_PATH=C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v10.1
    SET CUDNN_INSTALL_PATH=C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v10.1
    SET INCLUDE=D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE;D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\ATLMFC\INCLUDE;C:\Program Files (x86)\Windows Kits\8.1\include\shared;C:\Program Files (x86)\Windows Kits\8.1\include\um;C:\Program Files (x86)\Windows Kits\8.1\include\winrt;
    SET LIB=D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\LIB\amd64;D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\ATLMFC\LIB\amd64;C:\Program Files (x86)\Windows Kits\8.1\lib\winv6.3\um\x64;
    SET PATH=D:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\IDE\CommonExtensions\Microsoft\TestWindow;D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\BIN\amd64;C:\WINDOWS\Microsoft.NET\Framework64\v4.0.30319;D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\VCPackages;D:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\IDE;D:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools;D:\Program Files (x86)\Microsoft Visual Studio 12.0\Team Tools\Performance Tools\x64;D:\Program Files (x86)\Microsoft Visual Studio 12.0\Team Tools\Performance Tools;C:\Program Files (x86)\Windows Kits\8.1\bin\x64;C:\Program Files (x86)\Windows Kits\8.1\bin\x86;C:\Program Files (x86)\Microsoft SDKs\Windows\v8.1A\bin\NETFX 4.5.1 Tools\x64\;;C:\WINDOWS\system32
    SET PWD=/proc/self/cwd
    SET PYTHON_BIN_PATH=D:/MyProject/tensorflow-windows-build-script-master/venv/Scripts/python.exe
    SET PYTHON_LIB_PATH=D:/MyProject/tensorflow-windows-build-script-master/venv/lib/site-packages
    SET TEMP=C:\Users\dell\AppData\Local\Temp
    SET TF_CUDA_CLANG=0
    SET TF_CUDA_COMPUTE_CAPABILITIES=3.5,7.0
    SET TF_CUDA_VERSION=10.1
    SET TF_CUDNN_VERSION=7
    SET TF_NEED_CUDA=1
    SET TF_NEED_OPENCL_SYCL=0
    SET TF_NEED_ROCM=0
    SET TMP=C:\Users\dell\AppData\Local\Temp
  D:/MyProject/tensorflow-windows-build-script-master/venv/Scripts/python.exe -B external/local_config_cuda/crosstool/windows/msvc_wrapper_for_nvcc.py /nologo /DCOMPILER_MSVC /DNOMINMAX /D_WIN32_WINNT=0x0600 /D_CRT_SECURE_NO_DEPRECATE /D_CRT_SECURE_NO_WARNINGS /D_SILENCE_STDEXT_HASH_DEPRECATION_WARNINGS /bigobj /Zm500 /J /Gy /GF /EHsc /wd4351 /wd4291 /wd4250 /wd4996 /Iexternal/com_google_absl /Ibazel-out/x64_windows-opt/genfiles/external/com_google_absl /Ibazel-out/x64_windows-opt/bin/external/com_google_absl /Iexternal/bazel_tools /Ibazel-out/x64_windows-opt/genfiles/external/bazel_tools /Ibazel-out/x64_windows-opt/bin/external/bazel_tools /showIncludes /MD /O2 /DNDEBUG -w /arch:AVX -nvcc_options=disable-warnings /W3 /wd4005 /wd4068 /wd4180 /wd4244 /wd4267 /wd4800 /DNOMINMAX /DWIN32_LEAN_AND_MEAN /D_CRT_SECURE_NO_WARNINGS /D_SCL_SECURE_NO_WARNINGS /D_ENABLE_EXTENDED_ALIGNED_STORAGE /Fobazel-out/x64_windows-opt/bin/external/com_google_absl/absl/numeric/_objs/int128/int128.o /c external/com_google_absl/absl/numeric/int128.cc
Execution platform: @bazel_tools//platforms:host_platform
cl: 脙眉脕卯脨脨 warning D9025 :脮媒脭脷脰脴脨麓隆掳/w隆卤(脫脙隆掳/W3隆卤)
脳垄脪芒: 掳眉潞卢脦脛录镁:  external/com_google_absl\absl/numeric/int128.h
脳垄脪芒: 掳眉潞卢脦脛录镁:   D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\cassert
脳垄脪芒: 掳眉潞卢脦脛录镁:    D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\yvals.h
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\xkeycheck.h
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtdefs.h
脳垄脪芒: 掳眉潞卢脦脛录镁:      D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\sal.h
脳垄脪芒: 掳眉潞卢脦脛录镁:       D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\ConcurrencySal.h
脳垄脪芒: 掳眉潞卢脦脛录镁:      D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\vadefs.h
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\use_ansi.h
脳垄脪芒: 掳眉潞卢脦脛录镁:    D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\assert.h
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtdefs.h
脳垄脪芒: 掳眉潞卢脦脛录镁:   D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\cmath
脳垄脪芒: 掳眉潞卢脦脛录镁:    D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\math.h
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtdefs.h
脳垄脪芒: 掳眉潞卢脦脛录镁:    D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\xtgmath.h
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\xtr1common
脳垄脪芒: 掳眉潞卢脦脛录镁:   D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\cstdint
脳垄脪芒: 掳眉潞卢脦脛录镁:    D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\stdint.h
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtdefs.h
脳垄脪芒: 掳眉潞卢脦脛录镁:   D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\cstring
脳垄脪芒: 掳眉潞卢脦脛录镁:    D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\string.h
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtdefs.h
脳垄脪芒: 掳眉潞卢脦脛录镁:   D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\iosfwd
脳垄脪芒: 掳眉潞卢脦脛录镁:    D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\cstdio
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\stdio.h
脳垄脪芒: 掳眉潞卢脦脛录镁:      D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtdefs.h
脳垄脪芒: 掳眉潞卢脦脛录镁:      D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\swprintf.inl
脳垄脪芒: 掳眉潞卢脦脛录镁:    D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\cwchar
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\wchar.h
脳垄脪芒: 掳眉潞卢脦脛录镁:      D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtdefs.h
脳垄脪芒: 掳眉潞卢脦脛录镁:      D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\wtime.inl
脳垄脪芒: 掳眉潞卢脦脛录镁:    D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\xstddef
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\stdlib.h
脳垄脪芒: 掳眉潞卢脦脛录镁:      D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtdefs.h
脳垄脪芒: 掳眉潞卢脦脛录镁:      D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\limits.h
脳垄脪芒: 掳眉潞卢脦脛录镁:       D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtdefs.h
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\cstddef
脳垄脪芒: 掳眉潞卢脦脛录镁:      D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\stddef.h
脳垄脪芒: 掳眉潞卢脦脛录镁:       D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtdefs.h
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\initializer_list
脳垄脪芒: 掳眉潞卢脦脛录镁:    D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtdbg.h
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtdefs.h
脳垄脪芒: 掳眉潞卢脦脛录镁:   D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\limits
脳垄脪芒: 掳眉潞卢脦脛录镁:    D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\ymath.h
脳垄脪芒: 掳眉潞卢脦脛录镁:    D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\cfloat
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\float.h
脳垄脪芒: 掳眉潞卢脦脛录镁:      D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtdefs.h
脳垄脪芒: 掳眉潞卢脦脛录镁:      D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtwrn.h
脳垄脪芒: 掳眉潞卢脦脛录镁:       D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\crtdefs.h
脳垄脪芒: 掳眉潞卢脦脛录镁:    D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\climits
脳垄脪芒: 掳眉潞卢脦脛录镁:   D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\utility
脳垄脪芒: 掳眉潞卢脦脛录镁:    D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\type_traits
脳垄脪芒: 掳眉潞卢脦脛录镁:     D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE\xrefwrap
脳垄脪芒: 掳眉潞卢脦脛录镁:   external/com_google_absl\absl/base/config.h
脳垄脪芒: 掳眉潞卢脦脛录镁:    external/com_google_absl\absl/base/policy_checks.h
external/com_google_absl\absl/base/policy_checks.h(50) : fatal error C1189: #error :  "This package requires Visual Studio 2015 Update 2 or higher."
Target //tensorflow:libtensorflow_cc.so failed to build
INFO: Elapsed time: 1040.724s, Critical Path: 31.97s
INFO: 5 processes: 5 local.
FAILED: Build did NOT complete successfully
WARNING: The following rc files are no longer being read, please transfer their contents or import their path into one of the standard rc files:
d:\myproject\tensorflow-windows-build-script-master\source/.bazelrc
INFO: Invocation ID: c58f4f6f-c479-4e3b-96b1-2e9192c188fa
ihuale commented 5 years ago

i don't what the garbled is

terryzhao127 commented 5 years ago

Weird... I don’t really know how it would be like this.

ihuale commented 5 years ago

ok, I will continue to find a solution, if I succeed, I will put here.

StevenRoodhorst commented 5 years ago

I think you switched from visual studio versions: external/com_google_absl\absl/base/policy_checks.h(50) : fatal error C1189: #error : "This package requires Visual Studio 2015 Update 2 or higher." Target //tensorflow:libtensorflow_cc.so failed to build

If you look in D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE, is something there? Probably you have to completely remove a previous version, otherwise it will keep looking in the wrong folders.

ihuale commented 5 years ago

@Steroes ok, i have a try

ihuale commented 5 years ago

failed again:

D:\MyProject\tensorflow-windows-build-script-master>build.ps1  -BazelBuildParameters --verbose_failures  -BuildCppAPI -ReserveSource -ReserveVenv

位于命令管道位置 1 的 cmdlet build.ps1
请为以下参数提供值:
BazelBuildParameters: --config=opt --config=cuda --define=no_tensorflow_py_deps=true --copt=-nvcc_options=disable-warnings //tensorflow:libtensorflow_cc.so

Select a Tensorflow version:
[1] 1 - v1.13.1  [2] 2 - v1.12.0  [3] 3 - v1.11.0  [S] Select another version  [?] 帮助 (默认值为“1”): 1
Found chocolatey installed.
Found pacman installed.
Found patch installed.
Found unzip installed.
Found bazel installed.
Make sure you have installed same version of bazel 0.20.0.
Are you sure you want to PROCEED? [y/n]: y
Found cmake installed.
Make sure you have installed same version of cmake 3.12.
Are you sure you want to PROCEED? [y/n]: y
Found git installed.
Found python installed.
Make sure you have installed same version of python 3.6.7.
Are you sure you want to PROCEED? [y/n]: y
Cloning into 'tensorflow'...
remote: Enumerating objects: 5395, done.
remote: Counting objects: 100% (5395/5395), done.
remote: Compressing objects: 100% (1836/1836), done.
remote: Total 555335 (delta 3567), reused 5339 (delta 3541), pack-reused 549940
Receiving objects: 100% (555335/555335), 328.76 MiB | 1.69 MiB/s, done.
Resolving deltas: 100% (447546/447546), done.
Checking out files: 100% (16764/16764), done.
Checking out files: 100% (7807/7807), done.
Note: checking out 'tags/v1.13.1'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:

  git checkout -b <new-branch-name>

HEAD is now at 6612da8951 Merge pull request #26101 from gunan/r1.13
Checking patch tensorflow/core/framework/op_kernel.h...
Applied patch tensorflow/core/framework/op_kernel.h cleanly.
Collecting six
  Using cached https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl
Collecting numpy
  Using cached https://files.pythonhosted.org/packages/ed/29/d97b6252591da5f8add0d25eecda296ea72729a0aad7998edba1981b47c8/numpy-1.16.2-cp36-cp36m-win_amd64.whl
Collecting wheel
  Using cached https://files.pythonhosted.org/packages/96/ba/a4702cbb6a3a485239fbe9525443446203f00771af9ac000fa3ef2788201/wheel-0.33.1-py2.py3-none-any.whl
Installing collected packages: six, numpy, wheel
Successfully installed numpy-1.16.2 six-1.12.0 wheel-0.33.1
You are using pip version 10.0.1, however version 19.0.3 is available.
You should consider upgrading via the 'python -m pip install --upgrade pip' command.
Collecting keras_applications==1.0.5
  Using cached https://files.pythonhosted.org/packages/3f/9c/6e9393ead970fd97be0cfde912697dafec5800d9191f5ba25352fa537d72/Keras_Applications-1.0.5-py2.py3-none-any.whl
Installing collected packages: keras-applications
Successfully installed keras-applications-1.0.5
You are using pip version 10.0.1, however version 19.0.3 is available.
You should consider upgrading via the 'python -m pip install --upgrade pip' command.
Collecting keras_preprocessing==1.0.3
  Using cached https://files.pythonhosted.org/packages/b3/bd/796f986980da4d6adc77ffd8b2b11074e7b17a7b74b03789aefac5709c4b/Keras_Preprocessing-1.0.3-py2.py3-none-any.whl
Installing collected packages: keras-preprocessing
Successfully installed keras-preprocessing-1.0.3
You are using pip version 10.0.1, however version 19.0.3 is available.
You should consider upgrading via the 'python -m pip install --upgrade pip' command.
WARNING: The following rc files are no longer being read, please transfer their contents or import their path into one of the standard rc files:
nul
WARNING: --batch mode is deprecated. Please instead explicitly shut down your Bazel server using the command "bazel shutdown".
INFO: Invocation ID: 47b05a06-1534-4b43-a8b5-65244743c68d
You have bazel 0.20.0 installed.
Do you wish to build TensorFlow with XLA JIT support? [y/N]: N
No XLA JIT support will be enabled for TensorFlow.

Do you wish to build TensorFlow with ROCm support? [y/N]: N
No ROCm support will be enabled for TensorFlow.

Do you wish to build TensorFlow with CUDA support? [y/N]: y
CUDA support will be enabled for TensorFlow.

Please specify the CUDA SDK version you want to use. [Leave empty to default to CUDA 10.0]: 10.1

Please specify the location where CUDA 10.1 toolkit is installed. Refer to README.md for more details. [Default is C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v10.1]:

Please specify the cuDNN version you want to use. [Leave empty to default to cuDNN 7]: 7.5

Please specify the location where cuDNN 7 library is installed. Refer to README.md for more details. [Default is C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v10.1]:

Please specify a list of comma-separated Cuda compute capabilities you want to build with.
You can find the compute capability of your device at: https://developer.nvidia.com/cuda-gpus.
Please note that each additional compute capability significantly increases your build time and binary size. [Default is: 3.5,7.0]:

Please specify optimization flags to use during compilation when bazel option "--config=opt" is specified [Default is /arch:AVX]:

Would you like to override eigen strong inline for some C++ compilation to reduce the compilation time? [Y/n]: Y
Eigen strong inline overridden.

Preconfigured Bazel build configs. You can use any of the below by adding "--config=<>" to your build command. See .bazelrc for more details.
        --config=mkl            # Build with MKL support.
        --config=monolithic     # Config for mostly static monolithic build.
        --config=gdr            # Build with GDR support.
        --config=verbs          # Build with libverbs support.
        --config=ngraph         # Build with Intel nGraph support.
        --config=dynamic_kernels        # (Experimental) Build kernels into separate shared objects.
Preconfigured Bazel build configs to DISABLE default on features:
        --config=noaws          # Disable AWS S3 filesystem support.
        --config=nogcp          # Disable GCP support.
        --config=nohdfs         # Disable HDFS support.
        --config=noignite       # Disable Apacha Ignite support.
        --config=nokafka        # Disable Apache Kafka support.
        --config=nonccl         # Disable NVIDIA NCCL support.
WARNING: The following rc files are no longer being read, please transfer their contents or import their path into one of the standard rc files:
d:\myproject\tensorflow-windows-build-script-master\source/.bazelrc
Starting local Bazel server and connecting to it...
WARNING: The following configs were expanded more than once: [cuda]. For repeatable flags, repeats are counted twice and may lead to unexpected behavior.
WARNING: Option 'experimental_shortened_obj_file_path' is deprecated
INFO: Invocation ID: f2bc2916-a398-4d74-9a93-590e5745abe6
INFO: Analysed target //tensorflow:libtensorflow_cc.so (103 packages loaded, 8292 targets configured).
INFO: Found 1 target...
ERROR: C:/users/dell/_bazel_dell/7lybdmg5/external/protobuf_archive/BUILD:259:1: C++ compilation of rule '@protobuf_archive//:protoc_lib' failed (Exit 1): python.exe failed: error executing command
  cd C:/users/dell/_bazel_dell/7lybdmg5/execroot/org_tensorflow
  SET CUDA_TOOLKIT_PATH=C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v10.1
    SET CUDNN_INSTALL_PATH=C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v10.1
    SET INCLUDE=D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE;D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\ATLMFC\INCLUDE;C:\Program Files (x86)\Windows Kits\8.1\include\shared;C:\Program Files (x86)\Windows Kits\8.1\include\um;C:\Program Files (x86)\Windows Kits\8.1\include\winrt;
    SET LIB=D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\LIB\amd64;D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\ATLMFC\LIB\amd64;C:\Program Files (x86)\Windows Kits\8.1\lib\winv6.3\um\x64;
    SET PATH=D:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\IDE\CommonExtensions\Microsoft\TestWindow;D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\BIN\amd64;C:\WINDOWS\Microsoft.NET\Framework64\v4.0.30319;D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\VCPackages;D:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\IDE;D:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools;D:\Program Files (x86)\Microsoft Visual Studio 12.0\Team Tools\Performance Tools\x64;D:\Program Files (x86)\Microsoft Visual Studio 12.0\Team Tools\Performance Tools;C:\Program Files (x86)\Windows Kits\8.1\bin\x64;C:\Program Files (x86)\Windows Kits\8.1\bin\x86;C:\Program Files (x86)\Microsoft SDKs\Windows\v8.1A\bin\NETFX 4.5.1 Tools\x64\;;C:\WINDOWS\system32
    SET PWD=/proc/self/cwd
    SET PYTHON_BIN_PATH=D:/MyProject/tensorflow-windows-build-script-master/venv/Scripts/python.exe
    SET PYTHON_LIB_PATH=D:/MyProject/tensorflow-windows-build-script-master/venv/lib/site-packages
    SET TEMP=C:\Users\dell\AppData\Local\Temp
    SET TF_CUDA_CLANG=0
    SET TF_CUDA_COMPUTE_CAPABILITIES=3.5,7.0
    SET TF_CUDA_VERSION=10.1
    SET TF_CUDNN_VERSION=7
    SET TF_NEED_CUDA=1
    SET TF_NEED_OPENCL_SYCL=0
    SET TF_NEED_ROCM=0
    SET TMP=C:\Users\dell\AppData\Local\Temp
  D:/MyProject/tensorflow-windows-build-script-master/venv/Scripts/python.exe -B external/local_config_cuda/crosstool/windows/msvc_wrapper_for_nvcc.py /nologo /DCOMPILER_MSVC /DNOMINMAX /D_WIN32_WINNT=0x0600 /D_CRT_SECURE_NO_DEPRECATE /D_CRT_SECURE_NO_WARNINGS /D_SILENCE_STDEXT_HASH_DEPRECATION_WARNINGS /bigobj /Zm500 /J /Gy /GF /EHsc /wd4351 /wd4291 /wd4250 /wd4996 /Iexternal/protobuf_archive /Ibazel-out/x64_windows-opt/genfiles/external/protobuf_archive /Ibazel-out/x64_windows-opt/bin/external/protobuf_archive /Iexternal/bazel_tools /Ibazel-out/x64_windows-opt/genfiles/external/bazel_tools /Ibazel-out/x64_windows-opt/bin/external/bazel_tools /Iexternal/protobuf_archive/src /Ibazel-out/x64_windows-opt/genfiles/external/protobuf_archive/src /Ibazel-out/x64_windows-opt/bin/external/protobuf_archive/src /showIncludes /MD /O2 /DNDEBUG -w /arch:AVX -nvcc_options=disable-warnings /DHAVE_PTHREAD /wd4018 /wd4514 /Fobazel-out/x64_windows-opt/bin/external/protobuf_archive/_objs/protoc_lib/csharp_wrapper_field.o /c external/protobuf_archive/src/google/protobuf/compiler/csharp/csharp_wrapper_field.cc
Execution platform: @bazel_tools//platforms:host_platform
Traceback (most recent call last):
  File "external/local_config_cuda/crosstool/windows/msvc_wrapper_for_nvcc.py", line 192, in <module>
    sys.exit(main())
  File "external/local_config_cuda/crosstool/windows/msvc_wrapper_for_nvcc.py", line 189, in main
    return subprocess.call([CPU_COMPILER] + cpu_compiler_flags)
  File "C:\Users\dell\AppData\Local\Programs\Python\Python36\lib\subprocess.py", line 267, in call
    with Popen(*popenargs, **kwargs) as p:
  File "C:\Users\dell\AppData\Local\Programs\Python\Python36\lib\subprocess.py", line 709, in __init__
    restore_signals, start_new_session)
  File "C:\Users\dell\AppData\Local\Programs\Python\Python36\lib\subprocess.py", line 997, in _execute_child
    startupinfo)
FileNotFoundError: [WinError 2] 脧碌脥鲁脮脪虏禄碌陆脰赂露篓碌脛脦脛录镁隆拢
Target //tensorflow:libtensorflow_cc.so failed to build
INFO: Elapsed time: 27.036s, Critical Path: 7.38s
INFO: 5 processes: 5 local.
FAILED: Build did NOT complete successfully
WARNING: The following rc files are no longer being read, please transfer their contents or import their path into one of the standard rc files:
d:\myproject\tensorflow-windows-build-script-master\source/.bazelrc
INFO: Invocation ID: 12b270f7-2f88-46a3-99c0-464296db9fcd

D:\MyProject\tensorflow-windows-build-script-master>
asbe commented 5 years ago

@ihuale Seems we have identical setups apart from that you input 7.5 for CUDNN version. I leave it at default. For me the build works just fine - and I have tested the dll in a setup with a frozen object classifier graph.

ihuale commented 5 years ago

@asbe ok, i willl try default

ihuale commented 5 years ago

@asbe failed again.... 

Do you wish to build TensorFlow with CUDA support? [y/N]: y
CUDA support will be enabled for TensorFlow.

Please specify the CUDA SDK version you want to use. [Leave empty to default to CUDA 10.0]: 10.1

Please specify the location where CUDA 10.1 toolkit is installed. Refer to README.md for more details. [Default is C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v10.1]:

Please specify the cuDNN version you want to use. [Leave empty to default to cuDNN 7]:

Please specify the location where cuDNN 7 library is installed. Refer to README.md for more details. [Default is C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v10.1]:

Please specify a list of comma-separated Cuda compute capabilities you want to build with.
You can find the compute capability of your device at: https://developer.nvidia.com/cuda-gpus.
Please note that each additional compute capability significantly increases your build time and binary size. [Default is: 3.5,7.0]:

Please specify optimization flags to use during compilation when bazel option "--config=opt" is specified [Default is /arch:AVX]:

Would you like to override eigen strong inline for some C++ compilation to reduce the compilation time? [Y/n]: n
Not overriding eigen strong inline, some compilations could take more than 20 mins.

Preconfigured Bazel build configs. You can use any of the below by adding "--config=<>" to your build command. See .bazelrc for more details.
        --config=mkl            # Build with MKL support.
        --config=monolithic     # Config for mostly static monolithic build.
        --config=gdr            # Build with GDR support.
        --config=verbs          # Build with libverbs support.
        --config=ngraph         # Build with Intel nGraph support.
        --config=dynamic_kernels        # (Experimental) Build kernels into separate shared objects.
Preconfigured Bazel build configs to DISABLE default on features:
        --config=noaws          # Disable AWS S3 filesystem support.
        --config=nogcp          # Disable GCP support.
        --config=nohdfs         # Disable HDFS support.
        --config=noignite       # Disable Apacha Ignite support.
        --config=nokafka        # Disable Apache Kafka support.
        --config=nonccl         # Disable NVIDIA NCCL support.
WARNING: The following rc files are no longer being read, please transfer their contents or import their path into one of the standard rc files:
d:\myproject\tensorflow-windows-build-script-master\source/.bazelrc
Starting local Bazel server and connecting to it...
WARNING: The following configs were expanded more than once: [cuda]. For repeatable flags, repeats are counted twice and may lead to unexpected behavior.
WARNING: Option 'experimental_shortened_obj_file_path' is deprecated
INFO: Invocation ID: 034facc7-b11e-4b73-b384-cac02458eddc
INFO: Analysed target //tensorflow:libtensorflow_cc.so (103 packages loaded, 8292 targets configured).
INFO: Found 1 target...
ERROR: C:/users/dell/_bazel_dell/7lybdmg5/external/protobuf_archive/BUILD:259:1: C++ compilation of rule '@protobuf_archive//:protoc_lib' failed (Exit 1): python.exe failed: error executing command
  cd C:/users/dell/_bazel_dell/7lybdmg5/execroot/org_tensorflow
  SET CUDA_TOOLKIT_PATH=C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v10.1
    SET CUDNN_INSTALL_PATH=C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v10.1
    SET INCLUDE=D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\INCLUDE;D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\ATLMFC\INCLUDE;C:\Program Files (x86)\Windows Kits\8.1\include\shared;C:\Program Files (x86)\Windows Kits\8.1\include\um;C:\Program Files (x86)\Windows Kits\8.1\include\winrt;
    SET LIB=D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\LIB\amd64;D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\ATLMFC\LIB\amd64;C:\Program Files (x86)\Windows Kits\8.1\lib\winv6.3\um\x64;
    SET PATH=D:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\IDE\CommonExtensions\Microsoft\TestWindow;D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\BIN\amd64;C:\WINDOWS\Microsoft.NET\Framework64\v4.0.30319;D:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\VCPackages;D:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\IDE;D:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools;D:\Program Files (x86)\Microsoft Visual Studio 12.0\Team Tools\Performance Tools\x64;D:\Program Files (x86)\Microsoft Visual Studio 12.0\Team Tools\Performance Tools;C:\Program Files (x86)\Windows Kits\8.1\bin\x64;C:\Program Files (x86)\Windows Kits\8.1\bin\x86;C:\Program Files (x86)\Microsoft SDKs\Windows\v8.1A\bin\NETFX 4.5.1 Tools\x64\;;C:\WINDOWS\system32
    SET PWD=/proc/self/cwd
    SET PYTHON_BIN_PATH=D:/MyProject/tensorflow-windows-build-script-master/venv/Scripts/python.exe
    SET PYTHON_LIB_PATH=D:/MyProject/tensorflow-windows-build-script-master/venv/lib/site-packages
    SET TEMP=C:\Users\dell\AppData\Local\Temp
    SET TF_CUDA_CLANG=0
    SET TF_CUDA_COMPUTE_CAPABILITIES=3.5,7.0
    SET TF_CUDA_VERSION=10.1
    SET TF_CUDNN_VERSION=7
    SET TF_NEED_CUDA=1
    SET TF_NEED_OPENCL_SYCL=0
    SET TF_NEED_ROCM=0
    SET TMP=C:\Users\dell\AppData\Local\Temp
  D:/MyProject/tensorflow-windows-build-script-master/venv/Scripts/python.exe -B external/local_config_cuda/crosstool/windows/msvc_wrapper_for_nvcc.py /nologo /DCOMPILER_MSVC /DNOMINMAX /D_WIN32_WINNT=0x0600 /D_CRT_SECURE_NO_DEPRECATE /D_CRT_SECURE_NO_WARNINGS /D_SILENCE_STDEXT_HASH_DEPRECATION_WARNINGS /bigobj /Zm500 /J /Gy /GF /EHsc /wd4351 /wd4291 /wd4250 /wd4996 /Iexternal/protobuf_archive /Ibazel-out/x64_windows-opt/genfiles/external/protobuf_archive /Ibazel-out/x64_windows-opt/bin/external/protobuf_archive /Iexternal/bazel_tools /Ibazel-out/x64_windows-opt/genfiles/external/bazel_tools /Ibazel-out/x64_windows-opt/bin/external/bazel_tools /Iexternal/protobuf_archive/src /Ibazel-out/x64_windows-opt/genfiles/external/protobuf_archive/src /Ibazel-out/x64_windows-opt/bin/external/protobuf_archive/src /showIncludes /MD /O2 /DNDEBUG -w /arch:AVX -nvcc_options=disable-warnings /DHAVE_PTHREAD /wd4018 /wd4514 /Fobazel-out/x64_windows-opt/bin/external/protobuf_archive/_objs/protoc_lib/plugin.pb.o /c external/protobuf_archive/src/google/protobuf/compiler/plugin.pb.cc
Execution platform: @bazel_tools//platforms:host_platform
Traceback (most recent call last):
  File "external/local_config_cuda/crosstool/windows/msvc_wrapper_for_nvcc.py", line 192, in <module>
    sys.exit(main())
  File "external/local_config_cuda/crosstool/windows/msvc_wrapper_for_nvcc.py", line 189, in main
    return subprocess.call([CPU_COMPILER] + cpu_compiler_flags)
  File "C:\Users\dell\AppData\Local\Programs\Python\Python36\lib\subprocess.py", line 267, in call
    with Popen(*popenargs, **kwargs) as p:
  File "C:\Users\dell\AppData\Local\Programs\Python\Python36\lib\subprocess.py", line 709, in __init__
    restore_signals, start_new_session)
  File "C:\Users\dell\AppData\Local\Programs\Python\Python36\lib\subprocess.py", line 997, in _execute_child
    startupinfo)
FileNotFoundError: [WinError 2] 脧碌脥鲁脮脪虏禄碌陆脰赂露篓碌脛脦脛录镁隆拢
Target //tensorflow:libtensorflow_cc.so failed to build
INFO: Elapsed time: 94.578s, Critical Path: 9.86s
INFO: 0 processes.
FAILED: Build did NOT complete successfully
WARNING: The following rc files are no longer being read, please transfer their contents or import their path into one of the standard rc files:
d:\myproject\tensorflow-windows-build-script-master\source/.bazelrc
INFO: Invocation ID: a37f692a-2b16-4e91-bdda-794aa9ae3d6f

D:\MyProject\tensorflow-windows-build-script-master>
terryzhao127 commented 5 years ago

Closed due to inactivity

aSmallsheep commented 5 years ago

Hi guikarist : I got the follow error: PS F:\tensorflow-windows-build-script-master\tensorflow-windows-build-script-master> .\build.ps1 -BazelBuildParameters --verbose_failures -BuildCppAPI -ReserveSource -ReserveVenv 方法调用失败，因为 [System.Management.Automation.Host.ChoiceDescription] 不包含名为“new”的方法。 所在位置 F:\tensorflow-windows-build-script-master\tensorflow-windows-build-script-ma ster\build.ps1:34 字符: 78

liao1995 commented 5 years ago

Hi guikarist : I got the follow error: PS F:\tensorflow-windows-build-script-master\tensorflow-windows-build-script-master> .\build.ps1 -BazelBuildParameters --verbose_failures -BuildCppAPI -ReserveSource -ReserveVenv 方法调用失败，因为 [System.Management.Automation.Host.ChoiceDescription] 不包含名为“new”的方法。 所在位置 F:\tensorflow-windows-build-script-master\tensorflow-windows-build-script-ma ster\build.ps1:34 字符: 78

  • $options[$i] = [System.Management.Automation.Host.ChoiceDescription]::new <<<< ("&$($i + 1) - $($supportedVersion

s[$i])",

  • CategoryInfo : InvalidOperation: (new:String) [], ParentContainsErrorRecordException
  • FullyQualifiedErrorId : MethodNotFound

got same error, did you solve it?