Fine tunning Bloom model - Failed to import transformers.training_args

seema-AIML commented 1 year ago

System Info

falcon-7b-instruct(url)

Who can help?

No response

Information

[X] The official example scripts
[ ] My own modified scripts

Tasks

[X] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
[ ] My own task or dataset (give details below)

Reproduction

from transformers import pipeline

sequences = pipeline( "Write a poem about Valencia.", max_length=200, do_sample=True, top_k=10, num_return_sequences=1, eos_token_id=tokenizer.eos_token_id, ) for seq in sequences: print(f"Result: {seq['generated_text']}")

Expected behavior

Hi,

while running transformers API models on local machine facing issue of, Failed to import transformers.pipelines because of the following error (look up to see its traceback): module 'numpy' has no attribute 'object'. np.object was a deprecated alias for the builtin object. How to fix this?

ydshieh commented 1 year ago

Hi @seema-AIML

Could you post the full trace log, please. Thank you in advance.

seema-AIML commented 1 year ago

from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("bigscience/bloom-560m") def tokenize_function(examples): return tokenizer(examples["text"], padding="max_length", truncation=True) tokenized_datasets = dataset.map(tokenize_function, batched=True)

from transformers import AutoModelForSequenceClassification model = AutoModelForSequenceClassification.from_pretrained("bigscience/bloom-560m", num_labels=5)

from builtins import object from transformers import TrainingArguments training_args = TrainingArguments(output_dir="test_trainer")

While creating TrainingArguments getting below error

AttributeError Traceback (most recent call last) ~\Anaconda3\lib\site-packages\transformers\utils\import_utils.py in _get_module(self, module_name) 1125 try: -> 1126 return importlib.import_module("." + module_name, self.name) 1127 except Exception as e:

~\Anaconda3\lib\importlib__init__.py in import_module(name, package) 126 level += 1 --> 127 return _bootstrap._gcd_import(name[level:], package, level) 128

~\Anaconda3\lib\importlib_bootstrap.py in _gcd_import(name, package, level)

~\Anaconda3\lib\importlib_bootstrap.py in _find_andload(name, import)

~\Anaconda3\lib\importlib_bootstrap.py in _find_and_loadunlocked(name, import)

~\Anaconda3\lib\importlib_bootstrap.py in _load_unlocked(spec)

~\Anaconda3\lib\importlib_bootstrap_external.py in exec_module(self, module)

~\Anaconda3\lib\importlib_bootstrap.py in _call_with_frames_removed(f, *args, **kwds)

~\Anaconda3\lib\site-packages\transformers\training_args.py in 29 from .debug_utils import DebugOption ---> 30 from .trainer_utils import ( 31 EvaluationStrategy,

~\Anaconda3\lib\site-packages\transformers\trainer_utils.py in 46 if is_tf_available(): ---> 47 import tensorflow as tf 48

~\Anaconda3\lib\site-packages\tensorflow__init__.py in 40 ---> 41 from tensorflow.python.tools import module_util as _module_util 42 from tensorflow.python.util.lazy_loader import LazyLoader as _LazyLoader

~\Anaconda3\lib\site-packages\tensorflow\python__init__.py in 45 # Bring in subpackages. ---> 46 from tensorflow.python import data 47 from tensorflow.python import distribute

~\Anaconda3\lib\site-packages\tensorflow\python\data__init__.py in 24 # pylint: disable=unused-import ---> 25 from tensorflow.python.data import experimental 26 from tensorflow.python.data.ops.dataset_ops import AUTOTUNE

~\Anaconda3\lib\site-packages\tensorflow\python\data\experimental__init__.py in 96 # pylint: disable=unused-import ---> 97 from tensorflow.python.data.experimental import service 98 from tensorflow.python.data.experimental.ops.batching import dense_to_ragged_batch

~\Anaconda3\lib\site-packages\tensorflow\python\data\experimental\service__init__.py in 352 --> 353 from tensorflow.python.data.experimental.ops.data_service_ops import distribute 354 from tensorflow.python.data.experimental.ops.data_service_ops import from_dataset_id

~\Anaconda3\lib\site-packages\tensorflow\python\data\experimental\ops\data_service_ops.py in 25 from tensorflow.python.compat import compat ---> 26 from tensorflow.python.data.experimental.ops import compression_ops 27 from tensorflow.python.data.experimental.ops.distribute_options import AutoShardPolicy

~\Anaconda3\lib\site-packages\tensorflow\python\data\experimental\ops\compression_ops.py in 19 ---> 20 from tensorflow.python.data.util import structure 21 from tensorflow.python.ops import gen_experimental_dataset_ops as ged_ops

~\Anaconda3\lib\site-packages\tensorflow\python\data\util\structure.py in 25 ---> 26 from tensorflow.python.data.util import nest 27 from tensorflow.python.framework import composite_tensor

~\Anaconda3\lib\site-packages\tensorflow\python\data\util\nest.py in 39 ---> 40 from tensorflow.python.framework import sparse_tensor as _sparse_tensor 41 from tensorflow.python.util import _pywrap_utils

~\Anaconda3\lib\site-packages\tensorflow\python\framework\sparse_tensor.py in 27 from tensorflow.python.framework import composite_tensor ---> 28 from tensorflow.python.framework import constant_op 29 from tensorflow.python.framework import dtypes

~\Anaconda3\lib\site-packages\tensorflow\python\framework\constant_op.py in 28 from tensorflow.python.eager import context ---> 29 from tensorflow.python.eager import execute 30 from tensorflow.python.framework import dtypes

~\Anaconda3\lib\site-packages\tensorflow\python\eager\execute.py in 26 from tensorflow.python.eager import core ---> 27 from tensorflow.python.framework import dtypes 28 from tensorflow.python.framework import ops

~\Anaconda3\lib\site-packages\tensorflow\python\framework\dtypes.py in 584 types_pb2.DT_STRING: --> 585 np.object, 586 types_pb2.DT_COMPLEX64:

~\Anaconda3\lib\site-packages\numpy__init.py in getattr(attr) 304 if attr in former_attrs: --> 305 raise AttributeError(former_attrs__[attr]) 306

AttributeError: module 'numpy' has no attribute 'object'. np.object was a deprecated alias for the builtin object. To avoid this error in existing code, use object by itself. Doing this will not modify any behavior and is safe. The aliases was originally deprecated in NumPy 1.20; for more details and guidance see the original release note at: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations

The above exception was the direct cause of the following exception:

RuntimeError Traceback (most recent call last)

in 1 from builtins import object ----> 2 from transformers import TrainingArguments 3 4 training_args = TrainingArguments(output_dir="test_trainer") ~\Anaconda3\lib\importlib\_bootstrap.py in _handle_fromlist(module, fromlist, import_, recursive) ~\Anaconda3\lib\site-packages\transformers\utils\import_utils.py in __getattr__(self, name) 1114 value = self._get_module(name) 1115 elif name in self._class_to_module.keys(): -> 1116 module = self._get_module(self._class_to_module[name]) 1117 value = getattr(module, name) 1118 else: ~\Anaconda3\lib\site-packages\transformers\utils\import_utils.py in _get_module(self, module_name) 1126 return importlib.import_module("." + module_name, self.__name__) 1127 except Exception as e: -> 1128 raise RuntimeError( 1129 f"Failed to import {self.__name__}.{module_name} because of the following error (look up to see its" 1130 f" traceback):\n{e}" RuntimeError: Failed to import transformers.training_args because of the following error (look up to see its traceback): module 'numpy' has no attribute 'object'. `np.object` was a deprecated alias for the builtin `object`. To avoid this error in existing code, use `object` by itself. Doing this will not modify any behavior and is safe. The aliases was originally deprecated in NumPy 1.20; for more details and guidance see the original release note at: https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations ____________________________________________________________________________________________________________________________ How to fix this?

ydshieh commented 1 year ago

The error occurs in tensorflow file.

~\Anaconda3\lib\site-packages\tensorflow\python\framework\dtypes.py in
584 types_pb2.DT_STRING:
--> 585 np.object,

If you don't need tensorflow, the quick way to check is to uninstall tensorflow and see if the issue is resolved. You can also try to create a new virtual environment, and install as pip install transformers[torch].

seema-AIML commented 1 year ago

created new a new virtual environment, and installed transformers[torch]. Still getting same error. I have not installed tensorflow in new virtual environment. when tried to uninstall tensorflow getting warning as WARNING: Skipping tensorflow as it is not installed.

ydshieh commented 1 year ago

Please provide the new full error log (the one that is run within the new environment).