dwang68
commented
5 years ago I removed the build folder in lib/scene_parser/rcnn, and try to rebuild it, but saw the following error Here is what I see in the rcnn folder, just wanna make sure that build is the only thing i should remove before rebuilding?
build config data init.py modeling rcnn.egg-info solver utils _C.cpython-37m-x86_64-linux-gnu.so csrc engine layers pycache setup.py structures
Here's the error I see when I rebuild:
`gcc -pthread -B /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DWITH_CUDA -I/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/TH -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/include/python3.7m -c /home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/vision.cpp -o build/temp.linux-x86_64-3.7/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/vision.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
gcc -pthread -B /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DWITH_CUDA -I/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/TH -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/include/python3.7m -c /home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/cpu/ROIAlign_cpu.cpp -o build/temp.linux-x86_64-3.7/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/cpu/ROIAlign_cpu.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
In file included from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/ATen/ATen.h:9:0,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/extension.h:4,
from /home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/cpu/vision.h:3,
from /home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/cpu/ROIAlign_cpu.cpp:2:
/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/cpu/ROIAlign_cpu.cpp: In lambda function:
/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:71:52: warning: ‘c10::ScalarType detail::scalar_type(const at::DeprecatedTypeProperties&)’ is deprecated [-Wdeprecated-declarations]
at::ScalarType _st = ::detail::scalar_type(TYPE); \
^
/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/cpu/ROIAlign_cpu.cpp:242:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES’
AT_DISPATCH_FLOATING_TYPES(input.type(), "ROIAlign_forward", [&] {
^~~~~~
/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:47:23: note: declared here
inline at::ScalarType scalar_type(const at::DeprecatedTypeProperties &t) {
^~~
gcc -pthread -B /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DWITH_CUDA -I/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/TH -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/include/python3.7m -c /home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/cpu/nms_cpu.cpp -o build/temp.linux-x86_64-3.7/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/cpu/nms_cpu.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
In file included from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/ATen/ATen.h:9:0,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
from /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/extension.h:4,
from /home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/cpu/vision.h:3,
from /home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/cpu/nms_cpu.cpp:2:
/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/cpu/nms_cpu.cpp: In lambda function:
/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:71:52: warning: ‘c10::ScalarType detail::scalar_type(const at::DeprecatedTypeProperties&)’ is deprecated [-Wdeprecated-declarations]
at::ScalarType _st = ::detail::scalar_type(TYPE); \
^
/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/cpu/nms_cpu.cpp:71:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES’
AT_DISPATCH_FLOATING_TYPES(dets.type(), "nms", [&] {
^~~~~~
/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/ATen/Dispatch.h:47:23: note: declared here
inline at::ScalarType scalar_type(const at::DeprecatedTypeProperties &t) {
^~~
/usr/local/cuda/bin/nvcc -DWITH_CUDA -I/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/TH -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/include/python3.7m -c /home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/cuda/deform_pool_kernel_cuda.cu -o build/temp.linux-x86_64-3.7/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/cuda/deform_pool_kernel_cuda.o -DCUDA_NO_HALF_OPERATORS -DCUDA_NO_HALF_CONVERSIONS -DCUDA_NO_HALF2_OPERATORS --compiler-options '-fPIC' -DCUDA_HAS_FP16=1 -DCUDA_NO_HALF_OPERATORS -DCUDA_NO_HALF_CONVERSIONS -DCUDA_NO_HALF2_OPERATORS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++11
error: command '/usr/local/cuda/bin/nvcc' failed with exit status 1
2019-07-21 00:24:52,940 scene_graph_generation INFO: Namespace(config_file='configs/baseline_res101.yaml', distributed=False, inference=False, instance=-1, local_rank=0, resume=0, use_freq_prior=False, visualize=False)
2019-07-21 00:24:52,940 scene_graph_generation INFO: Loaded configuration file configs/baseline_res101.yaml
2019-07-21 00:24:52,940 scene_graph_generation INFO: Saving config into: logs/config.yml
images_per_batch: 6, num_gpus: 1
images_per_batch: 1, num_gpus: 1
2019-07-21 00:25:22,154 scene_graph_generation.trainer INFO: Train data size: 56224
2019-07-21 00:25:22,154 scene_graph_generation.trainer INFO: Test data size: 26446
2019-07-21 00:25:26,275 scene_graph_generation.checkpointer INFO: Loading checkpoint from catalog://ImageNetPretrained/MSRA/R-101
2019-07-21 00:25:26,278 scene_graph_generation.checkpointer INFO: catalog://ImageNetPretrained/MSRA/R-101 points to https://dl.fbaipublicfiles.com/detectron/ImageNetPretrained/MSRA/R-101.pkl
2019-07-21 00:25:26,279 scene_graph_generation.checkpointer INFO: url https://dl.fbaipublicfiles.com/detectron/ImageNetPretrained/MSRA/R-101.pkl cached in /home/dalinw/.torch/models/R-101.pkl
2019-07-21 00:25:26,486 scene_graph_generation.trainer INFO: Start training
Traceback (most recent call last):
File "main.py", line 125, in
amiormu
wtliao
Error seen when I try to train the scene graph parser
This is after I follow the instruction to compile the cuda dependencies. cd lib/scene_parser/rcnn python setup.py build develop python main.py --config-file configs/baseline_res101.yaml
`Traceback (most recent call last): File "main.py", line 125, in
main()
File "main.py", line 120, in main
model = train(cfg, args)
File "main.py", line 69, in train
model.train()
File "/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/model.py", line 128, in train
loss_dict = self.scene_parser(imgs, targets)
File "/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/nn/modules/module.py", line 493, in call
result = self.forward(*input, kwargs)
File "/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/parser.py", line 47, in forward
proposals, proposal_losses = self.rpn(images, features, targets)
File "/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/nn/modules/module.py", line 493, in call
result = self.forward(*input, *kwargs)
File "/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/modeling/rpn/rpn.py", line 159, in forward
return self._forward_train(anchors, objectness, rpn_box_regression, targets)
File "/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/modeling/rpn/rpn.py", line 175, in _forward_train
anchors, objectness, rpn_box_regression, targets
File "/home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/nn/modules/module.py", line 493, in call
result = self.forward(input, kwargs)
File "/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/modeling/rpn/inference.py", line 140, in forward
sampled_boxes.append(self.forward_for_single_feature_map(a, o, b))
File "/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/modeling/rpn/inference.py", line 120, in forward_for_single_feature_map
score_field="objectness",
File "/home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/structures/boxlist_ops.py", line 27, in boxlist_nms
keep = _box_nms(boxes, score, nms_thresh)
RuntimeError: Not compiled with GPU support (nms at /home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/csrc/nms.h:22)
frame #0: c10::Error::Error(c10::SourceLocation, std::string const&) + 0x45 (0x1500a3f60dc5 in /home/dalinw/.conda/envs/torch1.1_python3.7_cuda10/lib/python3.7/site-packages/torch/lib/libc10.so)
frame #1: nms(at::Tensor const&, at::Tensor const&, float) + 0xb2 (0x15008d9debc2 in /home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/_C.cpython-37m-x86_64-linux-gnu.so)
frame #2: + 0x16f36 (0x15008d9ebf36 in /home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/_C.cpython-37m-x86_64-linux-gnu.so)
frame #3: + 0x16fbe (0x15008d9ebfbe in /home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/_C.cpython-37m-x86_64-linux-gnu.so)
frame #4: + 0x1460d (0x15008d9e960d in /home/dalinw/DeployedProjects/ml_models/models/pygcn/visual_genome_deterministic/graph-rcnn.pytorch-master/lib/scene_parser/rcnn/_C.cpython-37m-x86_64-linux-gnu.so)