OFA-Sys / OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
Apache License 2.0
2.4k stars 247 forks source link

Captioning training does not start in Kaggle #331

Open Lednik7 opened 1 year ago

Lednik7 commented 1 year ago

I tried P100 kaggle session with:

!python -m pip install pip==21.2.4
!pip uninstall fairseq
!git clone https://github.com/OFA-Sys/OFA
!cd OFA && pip install -r requirements.txt
!cd OFA/run_scripts/caption && sh evaluate_caption.sh # ok
!python OFA/train.py --task "caption" --user-dir "OFA/ofa_module" # failed

Error: ImportError: /lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by /opt/conda/lib/python3.7/site-packages/pyarrow/../../../libarrow.so.500)

Traceback (most recent call last):
  File "OFA/train.py", line 537, in <module>
    cli_main()
  File "OFA/train.py", line 516, in cli_main
    parser = options.get_training_parser()
  File "/kaggle/working/OFA/fairseq/fairseq/options.py", line 38, in get_training_parser
    parser = get_parser("Trainer", default_task)
  File "/kaggle/working/OFA/fairseq/fairseq/options.py", line 227, in get_parser
    utils.import_user_module(usr_args)
  File "/kaggle/working/OFA/fairseq/fairseq/utils.py", line 489, in import_user_module
    importlib.import_module(module_name)
  File "/opt/conda/lib/python3.7/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/kaggle/working/OFA/ofa_module/__init__.py", line 3, in <module>
    import tasks
  File "/kaggle/working/OFA/tasks/__init__.py", line 3, in <module>
    from .nlg_tasks import *
  File "/kaggle/working/OFA/tasks/nlg_tasks/__init__.py", line 1, in <module>
    from .gigaword import GigawordTask
  File "/kaggle/working/OFA/tasks/nlg_tasks/gigaword.py", line 19, in <module>
    from datasets import load_metric
  File "/opt/conda/lib/python3.7/site-packages/datasets/__init__.py", line 22, in <module>
    import pyarrow
  File "/opt/conda/lib/python3.7/site-packages/pyarrow/__init__.py", line 63, in <module>
    import pyarrow.lib as _lib
ImportError: /lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by /opt/conda/lib/python3.7/site-packages/pyarrow/../../../libarrow.so.500)

!apt-get install --only-upgrade libstdc++6 ->

Reading package lists... Done
Building dependency tree       
Reading state information... Done
libstdc++6 is already the newest version (10.3.0-1ubuntu1~20.04).
0 upgraded, 0 newly installed, 0 to remove and 114 not upgraded.

But it didn't solve my problem

JustinLin610 commented 1 year ago

Have you tried it on any other devices?