and then i use the command to train the baseline model config
sh tools/dist_train.sh ./projects/openlanev2/configs/baseline.py 8
but i met the errors like this:
File "/usr/local/bin/conda/envs/openlv2/lib/python3.8/site-packages/mmengine/utils/misc.py", line 77, in import_modules_from_strings
imported_tmp = import_module(imp)
File "/usr/local/bin/conda/envs/openlv2/lib/python3.8/importlib/__init__.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
File "<frozen importlib._bootstrap>", line 991, in _find_and_load
File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 843, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/workspace/mmdetection3d/projects/openlanev2/baseline/__init__.py", line 1, in <module>
from .core import *
File "/workspace/mmdetection3d/projects/openlanev2/baseline/core/__init__.py", line 1, in <module>
from .bbox import *
File "/workspace/mmdetection3d/projects/openlanev2/baseline/core/bbox/__init__.py", line 1, in <module>
from .assigners import *
File "/workspace/mmdetection3d/projects/openlanev2/baseline/core/bbox/assigners.py", line 26, in <module>
from mmdet.core.bbox.builder import BBOX_ASSIGNERS
ModuleNotFoundError: No module named 'mmdet.core'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/conda/envs/openlv2/lib/python3.8/site-packages/mmengine/config/config.py", line 462, in fromfile
import_modules_from_strings(**cfg_dict['custom_imports'])
File "/usr/local/bin/conda/envs/openlv2/lib/python3.8/site-packages/mmengine/utils/misc.py", line 84, in import_modules_from_strings
raise ImportError(f'Failed to import {imp}')
ImportError: Failed to import projects.openlanev2.baseline
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "tools/train.py", line 135, in <module>
main()
File "tools/train.py", line 67, in main
cfg = Config.fromfile(args.config)
File "/usr/local/bin/conda/envs/openlv2/lib/python3.8/site-packages/mmengine/config/config.py", line 474, in fromfile
raise ImportError(err_msg) from e
ImportError: Failed to import custom modules from {'imports': ['projects.openlanev2.baseline']}, the current sys.path is:
/workspace/mmdetection3d/tools
/workspace/mmdetection3d
/usr/local/bin/conda/envs/openlv2/lib/python38.zip
/usr/local/bin/conda/envs/openlv2/lib/python3.8
/usr/local/bin/conda/envs/openlv2/lib/python3.8/lib-dynload
/root/.local/lib/python3.8/site-packages
/root/.local/lib/python3.8/site-packages/paddlecloudplatform-3.1.2-py3.8.egg
/usr/local/bin/conda/envs/openlv2/lib/python3.8/site-packages
/workspace/OpenLane-V2
You should set `PYTHONPATH` to make `sys.path` include the directory which contains your custom module
ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 27431) of binary: /usr/local/bin/conda/envs/openlv2/bin/python
Traceback (most recent call last):
File "/usr/local/bin/conda/envs/openlv2/lib/python3.8/runpy.py", line 194, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/local/bin/conda/envs/openlv2/lib/python3.8/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/usr/local/bin/conda/envs/openlv2/lib/python3.8/site-packages/torch/distributed/launch.py", line 193, in <module>
main()
File "/usr/local/bin/conda/envs/openlv2/lib/python3.8/site-packages/torch/distributed/launch.py", line 189, in main
launch(args)
File "/usr/local/bin/conda/envs/openlv2/lib/python3.8/site-packages/torch/distributed/launch.py", line 174, in launch
run(args)
File "/usr/local/bin/conda/envs/openlv2/lib/python3.8/site-packages/torch/distributed/run.py", line 689, in run
elastic_launch(
File "/usr/local/bin/conda/envs/openlv2/lib/python3.8/site-packages/torch/distributed/launcher/api.py", line 116, in __call__
return launch_agent(self._config, self._entrypoint, list(args))
File "/usr/local/bin/conda/envs/openlv2/lib/python3.8/site-packages/torch/distributed/launcher/api.py", line 244, in launch_agent
raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError:
***************************************
tools/train.py FAILED
=======================================
Root Cause:
[0]:
time: 2023-12-11_20:39:31
rank: 0 (local_rank: 0)
exitcode: 1 (pid: 27431)
error_file: <N/A>
msg: "Process failed with exitcode 1"
=======================================
Other Failures:
[1]:
time: 2023-12-11_20:39:31
rank: 1 (local_rank: 1)
exitcode: 1 (pid: 27432)
error_file: <N/A>
msg: "Process failed with exitcode 1"
[2]:
time: 2023-12-11_20:39:31
rank: 2 (local_rank: 2)
exitcode: 1 (pid: 27433)
error_file: <N/A>
msg: "Process failed with exitcode 1"
[3]:
time: 2023-12-11_20:39:31
rank: 3 (local_rank: 3)
exitcode: 1 (pid: 27434)
error_file: <N/A>
msg: "Process failed with exitcode 1"
[4]:
time: 2023-12-11_20:39:31
rank: 4 (local_rank: 4)
exitcode: 1 (pid: 27435)
error_file: <N/A>
msg: "Process failed with exitcode 1"
[5]:
time: 2023-12-11_20:39:31
rank: 5 (local_rank: 5)
exitcode: 1 (pid: 27436)
error_file: <N/A>
msg: "Process failed with exitcode 1"
[6]:
time: 2023-12-11_20:39:31
rank: 6 (local_rank: 6)
exitcode: 1 (pid: 27437)
error_file: <N/A>
msg: "Process failed with exitcode 1"
[7]:
time: 2023-12-11_20:39:31
rank: 7 (local_rank: 7)
exitcode: 1 (pid: 27438)
error_file: <N/A>
msg: "Process failed with exitcode 1"
***************************************
Hi, thanks for this great open-source work!
I have downloaded the dataset and configured the mmdetection3d, following https://github.com/open-mmlab/mmdetection3d/blob/v1.1.0rc0/docs/en/getting_started.md. The env info is:
and then i use the command to train the baseline model config
but i met the errors like this:
Does someone else meet this problem?