search

microsoft / DeepSpeedExamples

Example models using DeepSpeed
Apache License 2.0
6.02k stars 1.02k forks source link

`AttributeError: readonly attribute` while trying to run training/HelloDeepSpeed #878

Open htjain opened 6 months ago

htjain commented 6 months ago

I am trying to run training/HelloDeepSpeed example on a fresh python virtualenv but getting below error. I have installed dependencies using https://github.com/microsoft/DeepSpeedExamples/blob/master/training/HelloDeepSpeed/requirements.txt 

Traceback (most recent call last):
  File "/media/home/hemant/src/DeepSpeedExamples/training/HelloDeepSpeed/train_bert.py", line 10, in <module>
    import datasets
  File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/__init__.py", line 34, in <module>
    from .arrow_dataset import Dataset, concatenate_datasets
  File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 46, in <module>
    from .arrow_reader import ArrowReader
  File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/arrow_reader.py", line 33, in <module>
    from .table import InMemoryTable, MemoryMappedTable, Table, concat_tables
  File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/table.py", line 331, in <module>
    class InMemoryTable(TableBlock):
  File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/table.py", line 358, in InMemoryTable
    def from_pandas(cls, *args, **kwargs):
  File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/table.py", line 21, in wrapper
    out = wraps(arrow_table_method)(method)
  File "/usr/lib/python3.10/functools.py", line 61, in update_wrapper
    wrapper.__wrapped__ = wrapped
AttributeError: readonly attribute

Env details:

OS: Ubuntu 22.04 Python Version: 3.10.12