---------------------------------------ERROR MESSAGE----------------------------------------------------
(bigbird) kjk88@gpu2:~/bigbird$ sh -x bigbird/classifier/base_size.sh
python3 bigbird/classifier/run_classifier.py --data_dir=tfds://imdb_reviews/plain_text --output_dir=gs://bigbird-transformer-training/classifier/imdb
WARNING:tensorflow:From /home/kjk88/anaconda3/envs/bigbird/lib/python3.9/site-packages/tensorflow/python/compat/v2_compat.py:111: disable_resource_variables (from tensorflow.python.ops.variable_scope) is deprecated and will be removed in a future version.
Instructions for updating:
non-resource variables are not supported in the long term
Traceback (most recent call last):
File "/home/kjk88/bigbird/bigbird/classifier/run_classifier.py", line 460, in
app.run(main)
File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/site-packages/absl/app.py", line 303, in run
_run_main(main, args)
File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/site-packages/absl/app.py", line 251, in _run_main
sys.exit(main(argv))
File "/home/kjk88/bigbird/bigbird/classifier/run_classifier.py", line 375, in main
bert_config = flags.as_dictionary()
File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/site-packages/bigbird/core/flags.py", line 187, in as_dictionary
FLAGS.vocab_model_file = str(importlib_resources.files(bigbird).joinpath(
File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/importlib/resources.py", line 147, in files
return _common.from_package(_get_package(package))
File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/importlib/_common.py", line 14, in from_package
return fallback_resources(package.spec)
File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/importlib/_common.py", line 18, in fallback_resources
package_directory = pathlib.Path(spec.origin).parent
File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/pathlib.py", line 1082, in new
self = cls._from_parts(args, init=False)
File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/pathlib.py", line 707, in _from_parts
drv, root, parts = self._parse_args(args)
File "/home/kjk88/anaconda3/envs/bigbird/lib/python3.9/pathlib.py", line 691, in _parse_args
a = os.fspath(a)
TypeError: expected str, bytes or os.PathLike object, not NoneType
--num_tpu_cores=32 --init_checkpoint=gs://bigbird-transformer/pretrain/bigbr_base/model.ckpt-0
bigbird/classifier/base_size.sh: 24: bigbird/classifier/base_size.sh: --num_tpu_cores=32: not found
Hello google research~ Thanks for code for big bird. But i've got in trouble with the code. Below is the error message in terminal
my python version is 3.9.7 and version of packages are in below.
if you have a answer for this problem, please let me know ..
---------------------------------------VERSION OF PACKAGES----------------------------------------------------
Name Version Build Channel
_libgcc_mutex 0.1 main
_openmp_mutex 4.5 1_gnu
absl-py 0.12.0 pypi_0 pypi aiohttp 3.8.1 pypi_0 pypi aiosignal 1.2.0 pypi_0 pypi ale-py 0.7.3 pypi_0 pypi astunparse 1.6.3 pypi_0 pypi async-timeout 4.0.1 pypi_0 pypi attrs 21.2.0 pypi_0 pypi bigbird 0.0.1 pypi_0 pypi blessings 1.7 py39h06a4308_1002
bz2file 0.98 pypi_0 pypi ca-certificates 2021.10.26 h06a4308_2
cachetools 4.2.4 pypi_0 pypi certifi 2021.10.8 py39h06a4308_0
charset-normalizer 2.0.8 pypi_0 pypi chex 0.1.0 pypi_0 pypi click 8.0.3 pypi_0 pypi cloudpickle 2.0.0 pypi_0 pypi configparser 5.1.0 pypi_0 pypi cycler 0.11.0 pypi_0 pypi datasets 1.16.1 pypi_0 pypi decorator 5.1.0 pypi_0 pypi dill 0.3.4 pypi_0 pypi dm-tree 0.1.6 pypi_0 pypi docker-pycreds 0.4.0 pypi_0 pypi dopamine-rl 3.2.1 pypi_0 pypi filelock 3.4.0 pypi_0 pypi flask 2.0.2 pypi_0 pypi flatbuffers 2.0 pypi_0 pypi flax 0.3.6 pypi_0 pypi fonttools 4.28.2 pypi_0 pypi frozenlist 1.2.0 pypi_0 pypi fsspec 2021.11.1 pypi_0 pypi future 0.18.2 pypi_0 pypi gast 0.4.0 pypi_0 pypi gevent 21.8.0 pypi_0 pypi gin-config 0.5.0 pypi_0 pypi gitdb 4.0.9 pypi_0 pypi gitpython 3.1.24 pypi_0 pypi google-api-core 2.2.2 pypi_0 pypi google-api-python-client 2.31.0 pypi_0 pypi google-auth 2.3.3 pypi_0 pypi google-auth-httplib2 0.1.0 pypi_0 pypi google-auth-oauthlib 0.4.6 pypi_0 pypi google-pasta 0.2.0 pypi_0 pypi googleapis-common-protos 1.53.0 pypi_0 pypi gpustat 0.6.0 pyhd3eb1b0_1
greenlet 1.1.2 pypi_0 pypi grpcio 1.42.0 pypi_0 pypi gunicorn 20.1.0 pypi_0 pypi gym 0.21.0 pypi_0 pypi h5py 3.6.0 pypi_0 pypi httplib2 0.20.2 pypi_0 pypi huggingface-hub 0.2.0 pypi_0 pypi idna 3.3 pypi_0 pypi importlib-metadata 4.8.2 pypi_0 pypi importlib-resources 5.4.0 pypi_0 pypi itsdangerous 2.0.1 pypi_0 pypi jax 0.2.25 pypi_0 pypi jaxlib 0.1.74 pypi_0 pypi jinja2 3.0.3 pypi_0 pypi joblib 1.1.0 pypi_0 pypi keras 2.7.0 pypi_0 pypi keras-preprocessing 1.1.2 pypi_0 pypi kfac 0.2.0 pypi_0 pypi kiwisolver 1.3.2 pypi_0 pypi ld_impl_linux-64 2.35.1 h7274673_9
libclang 12.0.0 pypi_0 pypi libffi 3.3 he6710b0_2
libgcc-ng 9.3.0 h5101ec6_17
libgomp 9.3.0 h5101ec6_17
libstdcxx-ng 9.3.0 hd4cf53a_17
markdown 3.3.6 pypi_0 pypi markupsafe 2.0.1 pypi_0 pypi matplotlib 3.5.0 pypi_0 pypi mesh-tensorflow 0.1.19 pypi_0 pypi mpmath 1.2.1 pypi_0 pypi msgpack 1.0.3 pypi_0 pypi multidict 5.2.0 pypi_0 pypi multiprocess 0.70.12.2 pypi_0 pypi natsort 8.0.0 pypi_0 pypi ncurses 6.3 h7f8727e_2
nltk 3.6.5 pypi_0 pypi numpy 1.21.4 pypi_0 pypi nvidia-ml 7.352.0 pyhd3eb1b0_0
oauth2client 4.1.3 pypi_0 pypi oauthlib 3.1.1 pypi_0 pypi opencv-python 4.5.4.60 pypi_0 pypi openssl 1.1.1l h7f8727e_0
opt-einsum 3.3.0 pypi_0 pypi optax 0.1.0 pypi_0 pypi optimizers 2.1 pypi_0 pypi packaging 21.3 pypi_0 pypi pandas 1.3.4 pypi_0 pypi pathtools 0.1.2 pypi_0 pypi pillow 8.4.0 pypi_0 pypi pip 21.2.4 py39h06a4308_0
promise 2.3 pypi_0 pypi protobuf 3.19.1 pypi_0 pypi psutil 5.8.0 py39h27cfd23_1
pyarrow 6.0.1 pypi_0 pypi pyasn1 0.4.8 pypi_0 pypi pyasn1-modules 0.2.8 pypi_0 pypi pygame 2.1.0 pypi_0 pypi pyparsing 3.0.6 pypi_0 pypi pypng 0.0.21 pypi_0 pypi python 3.9.7 h12debd9_1
python-dateutil 2.8.2 pypi_0 pypi pytz 2021.3 pypi_0 pypi pyyaml 6.0 pypi_0 pypi readline 8.1 h27cfd23_0
regex 2021.11.10 pypi_0 pypi requests 2.26.0 pypi_0 pypi requests-oauthlib 1.3.0 pypi_0 pypi rouge-score 0.0.4 pypi_0 pypi rsa 4.8 pypi_0 pypi sacremoses 0.0.46 pypi_0 pypi scikit-learn 1.0.1 pypi_0 pypi scipy 1.7.3 pypi_0 pypi sentencepiece 0.1.96 pypi_0 pypi sentry-sdk 1.5.0 pypi_0 pypi setuptools 58.0.4 py39h06a4308_0
setuptools-scm 6.3.2 pypi_0 pypi shortuuid 1.0.8 pypi_0 pypi six 1.16.0 pyhd3eb1b0_0
sklearn 0.0 pypi_0 pypi smmap 5.0.0 pypi_0 pypi sqlite 3.36.0 hc218d9a_0
subprocess32 3.5.4 pypi_0 pypi sympy 1.9 pypi_0 pypi tensor2tensor 1.15.7 pypi_0 pypi tensorboard 2.7.0 pypi_0 pypi tensorboard-data-server 0.6.1 pypi_0 pypi tensorboard-plugin-wit 1.8.0 pypi_0 pypi tensorflow 2.7.0 pypi_0 pypi tensorflow-addons 0.15.0 pypi_0 pypi tensorflow-datasets 4.4.0 pypi_0 pypi tensorflow-estimator 2.7.0 pypi_0 pypi tensorflow-gan 2.1.0 pypi_0 pypi tensorflow-hub 0.12.0 pypi_0 pypi tensorflow-io-gcs-filesystem 0.22.0 pypi_0 pypi tensorflow-metadata 1.5.0 pypi_0 pypi tensorflow-probability 0.7.0 pypi_0 pypi tensorflow-text 2.7.3 pypi_0 pypi termcolor 1.1.0 pypi_0 pypi tf-slim 1.1.0 pypi_0 pypi tfds-nightly 4.4.0.dev202112010107 pypi_0 pypi threadpoolctl 3.0.0 pypi_0 pypi tk 8.6.11 h1ccaba5_0
tokenizer 3.3.2 pypi_0 pypi tokenizers 0.10.3 pypi_0 pypi tomli 1.2.2 pypi_0 pypi toolz 0.11.2 pypi_0 pypi torch 1.10.0 pypi_0 pypi tqdm 4.62.3 pypi_0 pypi transformers 4.12.5 pypi_0 pypi typeguard 2.13.2 pypi_0 pypi typing-extensions 3.10.0.2 pypi_0 pypi tzdata 2021e hda174b7_0
uritemplate 4.1.1 pypi_0 pypi urllib3 1.26.7 pypi_0 pypi wandb 0.12.7 pypi_0 pypi werkzeug 2.0.2 pypi_0 pypi wheel 0.37.0 pyhd3eb1b0_1
wrapt 1.13.3 pypi_0 pypi xxhash 2.0.2 pypi_0 pypi xz 5.2.5 h7b6447c_0
yarl 1.7.2 pypi_0 pypi yaspin 2.1.0 pypi_0 pypi zipp 3.6.0 pypi_0 pypi zlib 1.2.11 h7b6447c_3
zope-event 4.5.0 pypi_0 pypi zope-interface 5.4.0 pypi_0 pypi
---------------------------------------ERROR MESSAGE---------------------------------------------------- (bigbird) kjk88@gpu2:~/bigbird$ sh -x bigbird/classifier/base_size.sh