lyuwenyu
commented
8 months ago 先确定下paddle安装的版本没问题
Open littlesmallrookie opened 8 months ago
lyuwenyu
commented
8 months ago 先确定下paddle安装的版本没问题
littlesmallrookie
commented
8 months ago video fps: 29, frame_count: 856
Thread: 0; frame id: 0
Traceback (most recent call last):
File "deploy/pipeline/pipeline.py", line 1321, in
问题确认 Search before asking
请提出你的问题 Please ask your question
我们需要在边缘端进行车辆跟踪检测任务，边缘服务需要消耗小，性能快。请问在PP-Vehicle快速使用文档中，超轻量模型JetSon AGX 模型的训练流程是怎样的？ 我直接使用configs/ppvehicle/ppyoloe_plus_crn_t_auxhead_320_60e_ppvehicle.yml 训练时报错如下： Traceback (most recent call last): File "tools/train.py", line 202, in
main()
File "tools/train.py", line 198, in main
run(FLAGS, cfg)
File "tools/train.py", line 151, in run
trainer.train(FLAGS.eval)
File "/paddle/PaddleDetection/ppdet/engine/trainer.py", line 539, in train
outputs = model(data)
File "/root/miniconda3/envs/py38/lib/python3.8/site-packages/paddle/nn/layer/layers.py", line 1254, in call
return self.forward(*inputs, kwargs)
File "/paddle/PaddleDetection/ppdet/modeling/architectures/meta_arch.py", line 60, in forward
out = self.get_loss()
File "/paddle/PaddleDetection/ppdet/modeling/architectures/ppyoloe.py", line 257, in get_loss
return self._forward()
File "/paddle/PaddleDetection/ppdet/modeling/architectures/ppyoloe.py", line 224, in _forward
loss = self.yolo_head(
File "/root/miniconda3/envs/py38/lib/python3.8/site-packages/paddle/nn/layer/layers.py", line 1254, in call
return self.forward(*inputs, *kwargs)
File "/paddle/PaddleDetection/ppdet/modeling/heads/ppyoloe_head.py", line 264, in forward
return self.forward_train(feats, targets, aux_pred)
File "/paddle/PaddleDetection/ppdet/modeling/heads/ppyoloe_head.py", line 198, in forward_train
return self.get_loss([
File "/paddle/PaddleDetection/ppdet/modeling/heads/ppyoloe_head.py", line 439, in get_loss
self.assigner(
File "/root/miniconda3/envs/py38/lib/python3.8/site-packages/paddle/nn/layer/layers.py", line 1254, in call
return self.forward(inputs, kwargs)
File "/root/miniconda3/envs/py38/lib/python3.8/site-packages/decorator.py", line 232, in fun
return caller(func, *(extras + args), *kw)
File "/root/miniconda3/envs/py38/lib/python3.8/site-packages/paddle/fluid/dygraph/base.py", line 347, in _decorate_function
return func(args, *kwargs)
File "/paddle/PaddleDetection/ppdet/modeling/assigners/task_aligned_assigner.py", line 142, in forward
is_in_gts = is_close_gt(anchor_points, gt_bboxes, num_anchors_list)
File "/paddle/PaddleDetection/ppdet/modeling/assigners/task_aligned_assigner.py", line 50, in is_close_gt
dist_ratio[dist < max_dist] = 1.
File "/root/miniconda3/envs/py38/lib/python3.8/site-packages/paddle/fluid/dygraph/tensor_patch_methods.py", line 786, in setitem
return _setitemimpl(self, item, value)
File "/root/miniconda3/envs/py38/lib/python3.8/site-packages/paddle/fluid/variable_index.py", line 738, in _setitemimpl
return set_value_for_bool_tensor(var, slice_item, value)
File "/root/miniconda3/envs/py38/lib/python3.8/site-packages/paddle/fluid/variable_index.py", line 858, in set_value_for_bool_tensor
cond(item.any(), lambda: idx_not_empty(var, item, value))
File "/root/miniconda3/envs/py38/lib/python3.8/site-packages/paddle/static/nn/control_flow.py", line 975, in cond
pred = pred.item()
File "/root/miniconda3/envs/py38/lib/python3.8/site-packages/paddle/fluid/dygraph/tensor_patch_methods.py", line 581, in item
scalar = self._getitem_from_offset(args)
OSError: (External) CUDA error(719), unspecified launch failure.
[Hint: 'cudaErrorLaunchFailure'. An exception occurred on the device while executing a kernel. Common causes include dereferencing an invalid device pointerand accessing out of bounds shared memory. Less common cases can be system specific - more information about these cases canbe found in the system specific user guide. This leaves the process in an inconsistent state and any further CUDA work willreturn the same error. To continue using CUDA, the process must be terminated and relaunched.] (at ../paddle/phi/backends/gpu/cuda/cuda_info.cc:267)