2023-06-05 12:22:36.631833: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2023-06-05 12:22:37.323961: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/olivia/Segment-Everything-Everywhere-All-At-Once/demo_code/seem/lib/python3.9/site-packages/cv2/../../lib64:/usr/local/cuda-11.6/lib64:/usr/local/cuda-11.6/lib:
2023-06-05 12:22:37.324024: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/olivia/Segment-Everything-Everywhere-All-At-Once/demo_code/seem/lib/python3.9/site-packages/cv2/../../lib64:/usr/local/cuda-11.6/lib64:/usr/local/cuda-11.6/lib:
2023-06-05 12:22:37.324032: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
/home/olivia/Segment-Everything-Everywhere-All-At-Once/demo_code/seem/lib/python3.9/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.)
return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]
final text_encoder_type: bert-base-uncased
Some weights of the model checkpoint at bert-base-uncased were not used when initializing BertModel: ['cls.predictions.decoder.weight', 'cls.predictions.transform.dense.weight', 'cls.seq_relationship.weight', 'cls.predictions.bias', 'cls.predictions.transform.LayerNorm.bias', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.dense.bias']
This IS expected if you are initializing BertModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
This IS NOT expected if you are initializing BertModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
╭───────────────────────── Traceback (most recent call last) ──────────────────────────╮
│ /home/olivia/Segment-Everything-Everywhere-All-At-Once/demo_code/Grounded-Segment-An │
│ ything/grounded_sam_simple_demo.py:25 in │
│ │
│ 22 grounding_dino_model = Model(model_config_path=GROUNDING_DINO_CONFIG_PATH, mod │
│ 23 │
│ 24 # Building SAM Model and SAM Predictor │
│ ❱ 25 sam = sam_model_registrySAM_ENCODER_VERSION │
│ 26 sam_predictor = SamPredictor(sam) │
│ 27 │
│ 28 │
│ │
│ /home/olivia/Segment-Everything-Everywhere-All-At-Once/demo_code/Grounded-Segment-An │
│ ything/segment_anything/segment_anything/build_sam.py:15 in build_sam_vit_h │
│ │
│ 12 │
│ 13 │
│ 14 def build_sam_vit_h(checkpoint=None): │
│ ❱ 15 │ return _build_sam( │
│ 16 │ │ encoder_embed_dim=1280, │
│ 17 │ │ encoder_depth=32, │
│ 18 │ │ encoder_num_heads=16, │
│ │
│ /home/olivia/Segment-Everything-Everywhere-All-At-Once/demo_code/Grounded-Segment-An │
│ ything/segment_anything/segment_anything/build_sam.py:105 in _build_sam │
│ │
│ 102 │ sam.eval() │
│ 103 │ if checkpoint is not None: │
│ 104 │ │ with open(checkpoint, "rb") as f: │
│ ❱ 105 │ │ │ state_dict = torch.load(f) │
│ 106 │ │ sam.load_state_dict(state_dict) │
│ 107 │ return sam │
│ 108 │
│ │
│ /home/olivia/Segment-Everything-Everywhere-All-At-Once/demo_code/seem/lib/python3.9/ │
│ site-packages/torch/serialization.py:797 in load │
│ │
│ 794 │ │ │ # If we want to actually tail call to torch.jit.load, we need to │
│ 795 │ │ │ # reset back to the original position. │
│ 796 │ │ │ orig_position = opened_file.tell() │
│ ❱ 797 │ │ │ with _open_zipfile_reader(opened_file) as opened_zipfile: │
│ 798 │ │ │ │ if _is_torchscript_zip(opened_zipfile): │
│ 799 │ │ │ │ │ warnings.warn("'torch.load' received a zip file that look │
│ 800 │ │ │ │ │ │ │ │ " dispatching to 'torch.jit.load' (call 'to │
│ │
│ /home/olivia/Segment-Everything-Everywhere-All-At-Once/demo_code/seem/lib/python3.9/ │
│ site-packages/torch/serialization.py:283 in init │
│ │
│ 280 │
│ 281 class _open_zipfile_reader(_opener): │
│ 282 │ def init(self, name_or_buffer) -> None: │
│ ❱ 283 │ │ super().init(torch._C.PyTorchFileReader(name_or_buffer)) │
│ 284 │
│ 285 │
│ 286 class _open_zipfile_writer_file(_opener): │
╰──────────────────────────────────────────────────────────────────────────────────────╯
RuntimeError: PytorchStreamReader failed reading zip archive: failed finding central
directory
I would appreciate any assistance with this error.
lilyuam
commented
1 year ago
python3 grounded_sam_simple_demo.py
2023-06-05 12:22:36.631833: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 FMA To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags. 2023-06-05 12:22:37.323961: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/olivia/Segment-Everything-Everywhere-All-At-Once/demo_code/seem/lib/python3.9/site-packages/cv2/../../lib64:/usr/local/cuda-11.6/lib64:/usr/local/cuda-11.6/lib: 2023-06-05 12:22:37.324024: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /home/olivia/Segment-Everything-Everywhere-All-At-Once/demo_code/seem/lib/python3.9/site-packages/cv2/../../lib64:/usr/local/cuda-11.6/lib64:/usr/local/cuda-11.6/lib: 2023-06-05 12:22:37.324032: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly. /home/olivia/Segment-Everything-Everywhere-All-At-Once/demo_code/seem/lib/python3.9/site-packages/torch/functional.py:504: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3483.) return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] final text_encoder_type: bert-base-uncased Some weights of the model checkpoint at bert-base-uncased were not used when initializing BertModel: ['cls.predictions.decoder.weight', 'cls.predictions.transform.dense.weight', 'cls.seq_relationship.weight', 'cls.predictions.bias', 'cls.predictions.transform.LayerNorm.bias', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.dense.bias']
I would appreciate any assistance with this error.