LLM2Vec multi-gpu error

[Muennighoff]

2024-07-06 02:10:21 | ERROR | stderr | /env/lib/conda/gritkto/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2024-07-06 02:10:21 | ERROR | stderr |   warnings.warn(
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-07-06 02:10:22 | ERROR | stderr | 
Downloading shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:22 | ERROR | stderr | 
Downloading shards:  50%|█████     | 2/4 [00:00<00:00, 15.11it/s]
2024-07-06 02:10:22 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 15.01it/s]
2024-07-06 02:10:22 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 14.83it/s]
2024-07-06 02:10:22 | ERROR | stderr | 
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
2024-07-06 02:10:25 | ERROR | stderr | 
2024-07-06 02:10:32 | ERROR | stderr | 
Batches:   0%|          | 0/1 [00:00<?, ?it/s]
2024-07-06 02:10:46 | ERROR | stderr | /env/lib/conda/gritkto/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2024-07-06 02:10:46 | ERROR | stderr | /env/lib/conda/gritkto/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2024-07-06 02:10:46 | ERROR | stderr | /env/lib/conda/gritkto/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2024-07-06 02:10:46 | ERROR | stderr | /env/lib/conda/gritkto/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2024-07-06 02:10:46 | ERROR | stderr |   warnings.warn(
2024-07-06 02:10:46 | ERROR | stderr | /env/lib/conda/gritkto/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2024-07-06 02:10:46 | ERROR | stderr |   warnings.warn(
2024-07-06 02:10:46 | ERROR | stderr |   warnings.warn(
2024-07-06 02:10:46 | ERROR | stderr | /env/lib/conda/gritkto/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2024-07-06 02:10:46 | ERROR | stderr | /env/lib/conda/gritkto/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2024-07-06 02:10:46 | ERROR | stderr |   warnings.warn(
2024-07-06 02:10:46 | ERROR | stderr |   warnings.warn(
2024-07-06 02:10:46 | ERROR | stderr | /env/lib/conda/gritkto/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2024-07-06 02:10:46 | ERROR | stderr |   warnings.warn(
2024-07-06 02:10:46 | ERROR | stderr |   warnings.warn(
2024-07-06 02:10:47 | ERROR | stderr |   warnings.warn(
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:  50%|█████     | 2/4 [00:00<00:00, 15.33it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:  50%|█████     | 2/4 [00:00<00:00, 14.77it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:  50%|█████     | 2/4 [00:00<00:00, 15.22it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:  50%|█████     | 2/4 [00:00<00:00, 13.15it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:  50%|█████     | 2/4 [00:00<00:00, 14.38it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:  50%|█████     | 2/4 [00:00<00:00, 14.28it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:  50%|█████     | 2/4 [00:00<00:00, 15.16it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards:  50%|█████     | 2/4 [00:00<00:00, 11.60it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 14.90it/s]
2024-07-06 02:10:47 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 14.87it/s]
2024-07-06 02:10:48 | ERROR | stderr | 
2024-07-06 02:10:48 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 14.69it/s]
2024-07-06 02:10:48 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 14.70it/s]
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
2024-07-06 02:10:48 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 14.39it/s]
2024-07-06 02:10:48 | ERROR | stderr | 
2024-07-06 02:10:48 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 14.12it/s]
2024-07-06 02:10:48 | ERROR | stderr | 
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
2024-07-06 02:10:48 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 14.87it/s]
2024-07-06 02:10:48 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 14.72it/s]
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
2024-07-06 02:10:48 | ERROR | stderr | 
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
2024-07-06 02:10:48 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 13.26it/s]
2024-07-06 02:10:48 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 13.35it/s]
2024-07-06 02:10:48 | ERROR | stderr | 
2024-07-06 02:10:48 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 14.36it/s]
2024-07-06 02:10:48 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 12.99it/s]
2024-07-06 02:10:48 | ERROR | stderr | 
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
2024-07-06 02:10:48 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 15.00it/s]
2024-07-06 02:10:48 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 14.52it/s]
2024-07-06 02:10:48 | ERROR | stderr | 
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
2024-07-06 02:10:48 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 11.24it/s]
2024-07-06 02:10:48 | ERROR | stderr | 
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 11.03it/s]
2024-07-06 02:10:48 | ERROR | stderr | 
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`.
2024-07-06 02:10:56 | ERROR | stderr | 
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:56 | ERROR | stderr | 
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:58 | ERROR | stderr | 
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:58 | ERROR | stderr | 
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:58 | ERROR | stderr | 
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:58 | ERROR | stderr | 
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:59 | ERROR | stderr | 
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:59 | ERROR | stderr | 
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
2024-07-06 02:10:59 | ERROR | stderr | 
Loading checkpoint shards:  25%|██▌       | 1/4 [00:03<00:09,  3.04s/it]
2024-07-06 02:11:00 | ERROR | stderr | 
Loading checkpoint shards:  25%|██▌       | 1/4 [00:03<00:09,  3.18s/it]
2024-07-06 02:11:02 | ERROR | stderr | 
Loading checkpoint shards:  25%|██▌       | 1/4 [00:03<00:10,  3.64s/it]
2024-07-06 02:11:02 | ERROR | stderr | 
Loading checkpoint shards:  25%|██▌       | 1/4 [00:03<00:10,  3.66s/it]
2024-07-06 02:11:02 | ERROR | stderr | 
Loading checkpoint shards:  25%|██▌       | 1/4 [00:03<00:10,  3.49s/it]
2024-07-06 02:11:02 | ERROR | stderr | 
Loading checkpoint shards:  25%|██▌       | 1/4 [00:03<00:10,  3.45s/it]
2024-07-06 02:11:02 | ERROR | stderr | 
Loading checkpoint shards:  25%|██▌       | 1/4 [00:03<00:10,  3.51s/it]
2024-07-06 02:11:02 | ERROR | stderr | 
Loading checkpoint shards:  25%|██▌       | 1/4 [00:03<00:10,  3.60s/it]
2024-07-06 02:11:03 | ERROR | stderr | 
Loading checkpoint shards:  50%|█████     | 2/4 [00:06<00:06,  3.36s/it]
2024-07-06 02:11:03 | ERROR | stderr | 
Loading checkpoint shards:  50%|█████     | 2/4 [00:06<00:06,  3.41s/it]
2024-07-06 02:11:06 | ERROR | stderr | 
Loading checkpoint shards:  50%|█████     | 2/4 [00:07<00:08,  4.06s/it]
2024-07-06 02:11:06 | ERROR | stderr | 
Loading checkpoint shards:  50%|█████     | 2/4 [00:08<00:08,  4.21s/it]
2024-07-06 02:11:07 | ERROR | stderr | 
Loading checkpoint shards:  50%|█████     | 2/4 [00:07<00:08,  4.09s/it]
2024-07-06 02:11:07 | ERROR | stderr | 
Loading checkpoint shards:  50%|█████     | 2/4 [00:08<00:08,  4.12s/it]
2024-07-06 02:11:07 | ERROR | stderr | 
Loading checkpoint shards:  50%|█████     | 2/4 [00:08<00:08,  4.16s/it]
2024-07-06 02:11:07 | ERROR | stderr | 
Loading checkpoint shards:  50%|█████     | 2/4 [00:08<00:08,  4.19s/it]
2024-07-06 02:11:07 | ERROR | stderr | 
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:10<00:03,  3.67s/it]
2024-07-06 02:11:07 | ERROR | stderr | 
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:10<00:03,  3.70s/it]
2024-07-06 02:11:07 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.36s/it]
2024-07-06 02:11:07 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.37s/it]
2024-07-06 02:11:07 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.78s/it]
2024-07-06 02:11:07 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.77s/it]
2024-07-06 02:11:07 | ERROR | stderr | 
2024-07-06 02:11:07 | ERROR | stderr | 
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:11<00:03,  3.72s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.34s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:11<00:03,  3.67s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.89s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:11<00:03,  3.79s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:11<00:03,  3.72s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:11<00:03,  3.74s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:11<00:03,  3.72s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.39s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.95s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.33s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.86s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.34s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.88s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.35s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.33s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.90s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.89s/it]
2024-07-06 02:11:10 | ERROR | stderr | 
2024-07-06 02:11:10 | ERROR | stderr | 
2024-07-06 02:12:51 | ERROR | stderr | Traceback (most recent call last):
2024-07-06 02:12:51 | ERROR | stderr |   File "<string>", line 1, in <module>
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 116, in spawn_main
2024-07-06 02:12:51 | ERROR | stderr |     exitcode = _main(fd, parent_sentinel)
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 125, in _main
2024-07-06 02:12:51 | ERROR | stderr |     prepare(preparation_data)
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 236, in prepare
2024-07-06 02:12:51 | ERROR | stderr |     _fixup_main_from_path(data['init_main_from_path'])
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
2024-07-06 02:12:51 | ERROR | stderr |     main_content = runpy.run_path(main_path,
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 289, in run_path
2024-07-06 02:12:51 | ERROR | stderr |     return _run_module_code(code, init_globals, run_name,
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 96, in _run_module_code
2024-07-06 02:12:51 | ERROR | stderr |     _run_code(code, mod_globals, init_globals,
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 86, in _run_code
2024-07-06 02:12:51 | ERROR | stderr |     exec(code, run_globals)
2024-07-06 02:12:51 | ERROR | stderr |   File "/data/niklas/arena/run_vertex_index.py", line 22, in <module>
2024-07-06 02:12:51 | ERROR | stderr |     print(models.retrieve(query="Where is Japan?", model_name=model_name, corpus=corpus))
2024-07-06 02:12:51 | ERROR | stderr |   File "/data/niklas/arena/models.py", line 126, in retrieve
2024-07-06 02:12:51 | ERROR | stderr |     query_embed = model.encode([query])
2024-07-06 02:12:51 | ERROR | stderr |   File "/data/niklas/mteb/mteb/models/llm2vec_models.py", line 71, in encode
2024-07-06 02:12:51 | ERROR | stderr |     return self.model.encode(sentences, **kwargs)
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/site-packages/llm2vec/llm2vec.py", line 369, in encode
2024-07-06 02:12:51 | ERROR | stderr |     with cuda_compatible_multiprocess.Pool(num_proc) as p:
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 119, in Pool
2024-07-06 02:12:51 | ERROR | stderr |     return Pool(processes, initializer, initargs, maxtasksperchild,
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 215, in __init__
2024-07-06 02:12:51 | ERROR | stderr |     self._repopulate_pool()
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 306, in _repopulate_pool
2024-07-06 02:12:51 | ERROR | stderr |     return self._repopulate_pool_static(self._ctx, self.Process,
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 329, in _repopulate_pool_static
2024-07-06 02:12:51 | ERROR | stderr |     w.start()
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/process.py", line 121, in start
2024-07-06 02:12:51 | ERROR | stderr |     self._popen = self._Popen(self)
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 288, in _Popen
2024-07-06 02:12:51 | ERROR | stderr |     return Popen(process_obj)
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 32, in __init__
2024-07-06 02:12:51 | ERROR | stderr |     super().__init__(process_obj)
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_fork.py", line 19, in __init__
2024-07-06 02:12:51 | ERROR | stderr |     self._launch(process_obj)
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 42, in _launch
2024-07-06 02:12:51 | ERROR | stderr |     prep_data = spawn.get_preparation_data(process_obj._name)
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 154, in get_preparation_data
2024-07-06 02:12:51 | ERROR | stderr |     _check_not_importing_main()
2024-07-06 02:12:51 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 134, in _check_not_importing_main
2024-07-06 02:12:51 | ERROR | stderr |     raise RuntimeError('''
2024-07-06 02:12:51 | ERROR | stderr | RuntimeError:
2024-07-06 02:12:51 | ERROR | stderr |         An attempt has been made to start a new process before the
2024-07-06 02:12:51 | ERROR | stderr |         current process has finished its bootstrapping phase.
2024-07-06 02:12:51 | ERROR | stderr | 
2024-07-06 02:12:51 | ERROR | stderr |         This probably means that you are not using fork to start your
2024-07-06 02:12:51 | ERROR | stderr |         child processes and you have forgotten to use the proper idiom
2024-07-06 02:12:51 | ERROR | stderr |         in the main module:
2024-07-06 02:12:51 | ERROR | stderr | 
2024-07-06 02:12:51 | ERROR | stderr |             if __name__ == '__main__':
2024-07-06 02:12:51 | ERROR | stderr |                 freeze_support()
2024-07-06 02:12:51 | ERROR | stderr |                 ...
2024-07-06 02:12:51 | ERROR | stderr | 
2024-07-06 02:12:51 | ERROR | stderr |         The "freeze_support()" line can be omitted if the program
2024-07-06 02:12:51 | ERROR | stderr |         is not going to be frozen to produce an executable.
2024-07-06 02:12:53 | ERROR | stderr | Traceback (most recent call last):
2024-07-06 02:12:53 | ERROR | stderr |   File "<string>", line 1, in <module>
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 116, in spawn_main
2024-07-06 02:12:53 | ERROR | stderr |     exitcode = _main(fd, parent_sentinel)
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 125, in _main
2024-07-06 02:12:53 | ERROR | stderr |     prepare(preparation_data)
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 236, in prepare
2024-07-06 02:12:53 | ERROR | stderr |     _fixup_main_from_path(data['init_main_from_path'])
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
2024-07-06 02:12:53 | ERROR | stderr |     main_content = runpy.run_path(main_path,
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 289, in run_path
2024-07-06 02:12:53 | ERROR | stderr |     return _run_module_code(code, init_globals, run_name,
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 96, in _run_module_code
2024-07-06 02:12:53 | ERROR | stderr |     _run_code(code, mod_globals, init_globals,
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 86, in _run_code
2024-07-06 02:12:53 | ERROR | stderr |     exec(code, run_globals)
2024-07-06 02:12:53 | ERROR | stderr |   File "/data/niklas/arena/run_vertex_index.py", line 22, in <module>
2024-07-06 02:12:53 | ERROR | stderr |     print(models.retrieve(query="Where is Japan?", model_name=model_name, corpus=corpus))
2024-07-06 02:12:53 | ERROR | stderr |   File "/data/niklas/arena/models.py", line 126, in retrieve
2024-07-06 02:12:53 | ERROR | stderr |     query_embed = model.encode([query])
2024-07-06 02:12:53 | ERROR | stderr |   File "/data/niklas/mteb/mteb/models/llm2vec_models.py", line 71, in encode
2024-07-06 02:12:53 | ERROR | stderr |     return self.model.encode(sentences, **kwargs)
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/site-packages/llm2vec/llm2vec.py", line 369, in encode
2024-07-06 02:12:53 | ERROR | stderr |     with cuda_compatible_multiprocess.Pool(num_proc) as p:
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 119, in Pool
2024-07-06 02:12:53 | ERROR | stderr |     return Pool(processes, initializer, initargs, maxtasksperchild,
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 215, in __init__
2024-07-06 02:12:53 | ERROR | stderr |     self._repopulate_pool()
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 306, in _repopulate_pool
2024-07-06 02:12:53 | ERROR | stderr |     return self._repopulate_pool_static(self._ctx, self.Process,
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 329, in _repopulate_pool_static
2024-07-06 02:12:53 | ERROR | stderr |     w.start()
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/process.py", line 121, in start
2024-07-06 02:12:53 | ERROR | stderr |     self._popen = self._Popen(self)
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 288, in _Popen
2024-07-06 02:12:53 | ERROR | stderr |     return Popen(process_obj)
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 32, in __init__
2024-07-06 02:12:53 | ERROR | stderr |     super().__init__(process_obj)
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_fork.py", line 19, in __init__
2024-07-06 02:12:53 | ERROR | stderr |     self._launch(process_obj)
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 42, in _launch
2024-07-06 02:12:53 | ERROR | stderr |     prep_data = spawn.get_preparation_data(process_obj._name)
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 154, in get_preparation_data
2024-07-06 02:12:53 | ERROR | stderr |     _check_not_importing_main()
2024-07-06 02:12:53 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 134, in _check_not_importing_main
2024-07-06 02:12:53 | ERROR | stderr |     raise RuntimeError('''
2024-07-06 02:12:53 | ERROR | stderr | RuntimeError:
2024-07-06 02:12:53 | ERROR | stderr |         An attempt has been made to start a new process before the
2024-07-06 02:12:53 | ERROR | stderr |         current process has finished its bootstrapping phase.
2024-07-06 02:12:53 | ERROR | stderr | 
2024-07-06 02:12:53 | ERROR | stderr |         This probably means that you are not using fork to start your
2024-07-06 02:12:53 | ERROR | stderr |         child processes and you have forgotten to use the proper idiom
2024-07-06 02:12:53 | ERROR | stderr |         in the main module:
2024-07-06 02:12:53 | ERROR | stderr | 
2024-07-06 02:12:53 | ERROR | stderr |             if __name__ == '__main__':
2024-07-06 02:12:53 | ERROR | stderr |                 freeze_support()
2024-07-06 02:12:53 | ERROR | stderr |                 ...
2024-07-06 02:12:53 | ERROR | stderr | 
2024-07-06 02:12:53 | ERROR | stderr |         The "freeze_support()" line can be omitted if the program
2024-07-06 02:12:53 | ERROR | stderr |         is not going to be frozen to produce an executable.
2024-07-06 02:13:38 | ERROR | stderr | Traceback (most recent call last):
2024-07-06 02:13:38 | ERROR | stderr |   File "<string>", line 1, in <module>
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 116, in spawn_main
2024-07-06 02:13:38 | ERROR | stderr |     exitcode = _main(fd, parent_sentinel)
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 125, in _main
2024-07-06 02:13:38 | ERROR | stderr |     prepare(preparation_data)
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 236, in prepare
2024-07-06 02:13:38 | ERROR | stderr |     _fixup_main_from_path(data['init_main_from_path'])
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
2024-07-06 02:13:38 | ERROR | stderr |     main_content = runpy.run_path(main_path,
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 289, in run_path
2024-07-06 02:13:38 | ERROR | stderr |     return _run_module_code(code, init_globals, run_name,
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 96, in _run_module_code
2024-07-06 02:13:38 | ERROR | stderr |     _run_code(code, mod_globals, init_globals,
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 86, in _run_code
2024-07-06 02:13:38 | ERROR | stderr |     exec(code, run_globals)
2024-07-06 02:13:38 | ERROR | stderr |   File "/data/niklas/arena/run_vertex_index.py", line 22, in <module>
2024-07-06 02:13:38 | ERROR | stderr |     print(models.retrieve(query="Where is Japan?", model_name=model_name, corpus=corpus))
2024-07-06 02:13:38 | ERROR | stderr |   File "/data/niklas/arena/models.py", line 126, in retrieve
2024-07-06 02:13:38 | ERROR | stderr |     query_embed = model.encode([query])
2024-07-06 02:13:38 | ERROR | stderr |   File "/data/niklas/mteb/mteb/models/llm2vec_models.py", line 71, in encode
2024-07-06 02:13:38 | ERROR | stderr |     return self.model.encode(sentences, **kwargs)
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/site-packages/llm2vec/llm2vec.py", line 369, in encode
2024-07-06 02:13:38 | ERROR | stderr |     with cuda_compatible_multiprocess.Pool(num_proc) as p:
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 119, in Pool
2024-07-06 02:13:38 | ERROR | stderr |     return Pool(processes, initializer, initargs, maxtasksperchild,
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 215, in __init__
2024-07-06 02:13:38 | ERROR | stderr |     self._repopulate_pool()
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 306, in _repopulate_pool
2024-07-06 02:13:38 | ERROR | stderr |     return self._repopulate_pool_static(self._ctx, self.Process,
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 329, in _repopulate_pool_static
2024-07-06 02:13:38 | ERROR | stderr |     w.start()
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/process.py", line 121, in start
2024-07-06 02:13:38 | ERROR | stderr |     self._popen = self._Popen(self)
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 288, in _Popen
2024-07-06 02:13:38 | ERROR | stderr |     return Popen(process_obj)
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 32, in __init__
2024-07-06 02:13:38 | ERROR | stderr |     super().__init__(process_obj)
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_fork.py", line 19, in __init__
2024-07-06 02:13:38 | ERROR | stderr |     self._launch(process_obj)
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 42, in _launch
2024-07-06 02:13:38 | ERROR | stderr |     prep_data = spawn.get_preparation_data(process_obj._name)
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 154, in get_preparation_data
2024-07-06 02:13:38 | ERROR | stderr |     _check_not_importing_main()
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 134, in _check_not_importing_main
2024-07-06 02:13:38 | ERROR | stderr |     raise RuntimeError('''
2024-07-06 02:13:38 | ERROR | stderr | RuntimeError:
2024-07-06 02:13:38 | ERROR | stderr |         An attempt has been made to start a new process before the
2024-07-06 02:13:38 | ERROR | stderr |         current process has finished its bootstrapping phase.
2024-07-06 02:13:38 | ERROR | stderr | 
2024-07-06 02:13:38 | ERROR | stderr |         This probably means that you are not using fork to start your
2024-07-06 02:13:38 | ERROR | stderr |         child processes and you have forgotten to use the proper idiom
2024-07-06 02:13:38 | ERROR | stderr |         in the main module:
2024-07-06 02:13:38 | ERROR | stderr | 
2024-07-06 02:13:38 | ERROR | stderr |             if __name__ == '__main__':
2024-07-06 02:13:38 | ERROR | stderr |                 freeze_support()
2024-07-06 02:13:38 | ERROR | stderr |                 ...
2024-07-06 02:13:38 | ERROR | stderr | 
2024-07-06 02:13:38 | ERROR | stderr |         The "freeze_support()" line can be omitted if the program
2024-07-06 02:13:38 | ERROR | stderr |         is not going to be frozen to produce an executable.
2024-07-06 02:13:38 | ERROR | stderr | Traceback (most recent call last):
2024-07-06 02:13:38 | ERROR | stderr |   File "<string>", line 1, in <module>
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 116, in spawn_main
2024-07-06 02:13:38 | ERROR | stderr |     exitcode = _main(fd, parent_sentinel)
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 125, in _main
2024-07-06 02:13:38 | ERROR | stderr |     prepare(preparation_data)
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 236, in prepare
2024-07-06 02:13:38 | ERROR | stderr |     _fixup_main_from_path(data['init_main_from_path'])
2024-07-06 02:13:38 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
2024-07-06 02:13:38 | ERROR | stderr |     main_content = runpy.run_path(main_path,
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 289, in run_path
2024-07-06 02:13:39 | ERROR | stderr |     return _run_module_code(code, init_globals, run_name,
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 96, in _run_module_code
2024-07-06 02:13:39 | ERROR | stderr |     _run_code(code, mod_globals, init_globals,
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 86, in _run_code
2024-07-06 02:13:39 | ERROR | stderr |     exec(code, run_globals)
2024-07-06 02:13:39 | ERROR | stderr |   File "/data/niklas/arena/run_vertex_index.py", line 22, in <module>
2024-07-06 02:13:39 | ERROR | stderr |     print(models.retrieve(query="Where is Japan?", model_name=model_name, corpus=corpus))
2024-07-06 02:13:39 | ERROR | stderr |   File "/data/niklas/arena/models.py", line 126, in retrieve
2024-07-06 02:13:39 | ERROR | stderr |     query_embed = model.encode([query])
2024-07-06 02:13:39 | ERROR | stderr |   File "/data/niklas/mteb/mteb/models/llm2vec_models.py", line 71, in encode
2024-07-06 02:13:39 | ERROR | stderr |     return self.model.encode(sentences, **kwargs)
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/site-packages/llm2vec/llm2vec.py", line 369, in encode
2024-07-06 02:13:39 | ERROR | stderr |     with cuda_compatible_multiprocess.Pool(num_proc) as p:
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 119, in Pool
2024-07-06 02:13:39 | ERROR | stderr |     return Pool(processes, initializer, initargs, maxtasksperchild,
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 215, in __init__
2024-07-06 02:13:39 | ERROR | stderr |     self._repopulate_pool()
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 306, in _repopulate_pool
2024-07-06 02:13:39 | ERROR | stderr |     return self._repopulate_pool_static(self._ctx, self.Process,
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 329, in _repopulate_pool_static
2024-07-06 02:13:39 | ERROR | stderr |     w.start()
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/process.py", line 121, in start
2024-07-06 02:13:39 | ERROR | stderr |     self._popen = self._Popen(self)
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 288, in _Popen
2024-07-06 02:13:39 | ERROR | stderr |     return Popen(process_obj)
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 32, in __init__
2024-07-06 02:13:39 | ERROR | stderr |     super().__init__(process_obj)
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_fork.py", line 19, in __init__
2024-07-06 02:13:39 | ERROR | stderr |     self._launch(process_obj)
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 42, in _launch
2024-07-06 02:13:39 | ERROR | stderr |     prep_data = spawn.get_preparation_data(process_obj._name)
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 154, in get_preparation_data
2024-07-06 02:13:39 | ERROR | stderr |     _check_not_importing_main()
2024-07-06 02:13:39 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 134, in _check_not_importing_main
2024-07-06 02:13:39 | ERROR | stderr |     raise RuntimeError('''
2024-07-06 02:13:39 | ERROR | stderr | RuntimeError:
2024-07-06 02:13:39 | ERROR | stderr |         An attempt has been made to start a new process before the
2024-07-06 02:13:39 | ERROR | stderr |         current process has finished its bootstrapping phase.
2024-07-06 02:13:39 | ERROR | stderr | 
2024-07-06 02:13:39 | ERROR | stderr |         This probably means that you are not using fork to start your
2024-07-06 02:13:39 | ERROR | stderr |         child processes and you have forgotten to use the proper idiom
2024-07-06 02:13:39 | ERROR | stderr |         in the main module:
2024-07-06 02:13:39 | ERROR | stderr | 
2024-07-06 02:13:39 | ERROR | stderr |             if __name__ == '__main__':
2024-07-06 02:13:39 | ERROR | stderr |                 freeze_support()
2024-07-06 02:13:39 | ERROR | stderr |                 ...
2024-07-06 02:13:39 | ERROR | stderr | 
2024-07-06 02:13:39 | ERROR | stderr |         The "freeze_support()" line can be omitted if the program
2024-07-06 02:13:39 | ERROR | stderr |         is not going to be frozen to produce an executable.
2024-07-06 02:13:44 | ERROR | stderr | Traceback (most recent call last):
2024-07-06 02:13:44 | ERROR | stderr |   File "<string>", line 1, in <module>
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 116, in spawn_main
2024-07-06 02:13:44 | ERROR | stderr |     exitcode = _main(fd, parent_sentinel)
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 125, in _main
2024-07-06 02:13:44 | ERROR | stderr |     prepare(preparation_data)
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 236, in prepare
2024-07-06 02:13:44 | ERROR | stderr |     _fixup_main_from_path(data['init_main_from_path'])
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
2024-07-06 02:13:44 | ERROR | stderr |     main_content = runpy.run_path(main_path,
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 289, in run_path
2024-07-06 02:13:44 | ERROR | stderr |     return _run_module_code(code, init_globals, run_name,
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 96, in _run_module_code
2024-07-06 02:13:44 | ERROR | stderr | Traceback (most recent call last):
2024-07-06 02:13:44 | ERROR | stderr |     _run_code(code, mod_globals, init_globals,
2024-07-06 02:13:44 | ERROR | stderr |   File "<string>", line 1, in <module>
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 86, in _run_code
2024-07-06 02:13:44 | ERROR | stderr |     exec(code, run_globals)
2024-07-06 02:13:44 | ERROR | stderr | Traceback (most recent call last):
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 116, in spawn_main
2024-07-06 02:13:44 | ERROR | stderr |   File "/data/niklas/arena/run_vertex_index.py", line 22, in <module>
2024-07-06 02:13:44 | ERROR | stderr |   File "<string>", line 1, in <module>
2024-07-06 02:13:44 | ERROR | stderr |     exitcode = _main(fd, parent_sentinel)
2024-07-06 02:13:44 | ERROR | stderr |     print(models.retrieve(query="Where is Japan?", model_name=model_name, corpus=corpus))
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 116, in spawn_main
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 125, in _main
2024-07-06 02:13:44 | ERROR | stderr |   File "/data/niklas/arena/models.py", line 126, in retrieve
2024-07-06 02:13:44 | ERROR | stderr |     exitcode = _main(fd, parent_sentinel)
2024-07-06 02:13:44 | ERROR | stderr |     prepare(preparation_data)
2024-07-06 02:13:44 | ERROR | stderr |     query_embed = model.encode([query])
2024-07-06 02:13:44 | ERROR | stderr | Traceback (most recent call last):
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 125, in _main
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 236, in prepare
2024-07-06 02:13:44 | ERROR | stderr |   File "/data/niklas/mteb/mteb/models/llm2vec_models.py", line 71, in encode
2024-07-06 02:13:44 | ERROR | stderr |   File "<string>", line 1, in <module>
2024-07-06 02:13:44 | ERROR | stderr |     prepare(preparation_data)
2024-07-06 02:13:44 | ERROR | stderr |     _fixup_main_from_path(data['init_main_from_path'])
2024-07-06 02:13:44 | ERROR | stderr |     return self.model.encode(sentences, **kwargs)
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 116, in spawn_main
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 236, in prepare
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/site-packages/llm2vec/llm2vec.py", line 369, in encode
2024-07-06 02:13:44 | ERROR | stderr |     exitcode = _main(fd, parent_sentinel)
2024-07-06 02:13:44 | ERROR | stderr |     _fixup_main_from_path(data['init_main_from_path'])
2024-07-06 02:13:44 | ERROR | stderr |     main_content = runpy.run_path(main_path,
2024-07-06 02:13:44 | ERROR | stderr |     with cuda_compatible_multiprocess.Pool(num_proc) as p:
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 125, in _main
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 289, in run_path
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 119, in Pool
2024-07-06 02:13:44 | ERROR | stderr |     prepare(preparation_data)
2024-07-06 02:13:44 | ERROR | stderr |     main_content = runpy.run_path(main_path,
2024-07-06 02:13:44 | ERROR | stderr |     return _run_module_code(code, init_globals, run_name,
2024-07-06 02:13:44 | ERROR | stderr |     return Pool(processes, initializer, initargs, maxtasksperchild,
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 236, in prepare
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 289, in run_path
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 96, in _run_module_code
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 215, in __init__
2024-07-06 02:13:44 | ERROR | stderr |     _fixup_main_from_path(data['init_main_from_path'])
2024-07-06 02:13:44 | ERROR | stderr |     return _run_module_code(code, init_globals, run_name,
2024-07-06 02:13:44 | ERROR | stderr |     _run_code(code, mod_globals, init_globals,
2024-07-06 02:13:44 | ERROR | stderr |     self._repopulate_pool()
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 96, in _run_module_code
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 86, in _run_code
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 306, in _repopulate_pool
2024-07-06 02:13:44 | ERROR | stderr |     main_content = runpy.run_path(main_path,
2024-07-06 02:13:44 | ERROR | stderr |     _run_code(code, mod_globals, init_globals,
2024-07-06 02:13:44 | ERROR | stderr |     exec(code, run_globals)
2024-07-06 02:13:44 | ERROR | stderr |     return self._repopulate_pool_static(self._ctx, self.Process,
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 289, in run_path
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 86, in _run_code
2024-07-06 02:13:44 | ERROR | stderr |   File "/data/niklas/arena/run_vertex_index.py", line 22, in <module>
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 329, in _repopulate_pool_static
2024-07-06 02:13:44 | ERROR | stderr |     return _run_module_code(code, init_globals, run_name,
2024-07-06 02:13:44 | ERROR | stderr |     exec(code, run_globals)
2024-07-06 02:13:44 | ERROR | stderr |     print(models.retrieve(query="Where is Japan?", model_name=model_name, corpus=corpus))
2024-07-06 02:13:44 | ERROR | stderr |     w.start()
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 96, in _run_module_code
2024-07-06 02:13:44 | ERROR | stderr |   File "/data/niklas/arena/run_vertex_index.py", line 22, in <module>
2024-07-06 02:13:44 | ERROR | stderr |   File "/data/niklas/arena/models.py", line 126, in retrieve
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/process.py", line 121, in start
2024-07-06 02:13:44 | ERROR | stderr |     _run_code(code, mod_globals, init_globals,
2024-07-06 02:13:44 | ERROR | stderr |     print(models.retrieve(query="Where is Japan?", model_name=model_name, corpus=corpus))
2024-07-06 02:13:44 | ERROR | stderr |     query_embed = model.encode([query])
2024-07-06 02:13:44 | ERROR | stderr |     self._popen = self._Popen(self)
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/runpy.py", line 86, in _run_code
2024-07-06 02:13:44 | ERROR | stderr |   File "/data/niklas/arena/models.py", line 126, in retrieve
2024-07-06 02:13:44 | ERROR | stderr |   File "/data/niklas/mteb/mteb/models/llm2vec_models.py", line 71, in encode
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 288, in _Popen
2024-07-06 02:13:44 | ERROR | stderr |     exec(code, run_globals)
2024-07-06 02:13:44 | ERROR | stderr |     query_embed = model.encode([query])
2024-07-06 02:13:44 | ERROR | stderr |     return self.model.encode(sentences, **kwargs)
2024-07-06 02:13:44 | ERROR | stderr |     return Popen(process_obj)
2024-07-06 02:13:44 | ERROR | stderr |   File "/data/niklas/arena/run_vertex_index.py", line 22, in <module>
2024-07-06 02:13:44 | ERROR | stderr |   File "/data/niklas/mteb/mteb/models/llm2vec_models.py", line 71, in encode
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/site-packages/llm2vec/llm2vec.py", line 369, in encode
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 32, in __init__
2024-07-06 02:13:44 | ERROR | stderr |     print(models.retrieve(query="Where is Japan?", model_name=model_name, corpus=corpus))
2024-07-06 02:13:44 | ERROR | stderr |     return self.model.encode(sentences, **kwargs)
2024-07-06 02:13:44 | ERROR | stderr |     with cuda_compatible_multiprocess.Pool(num_proc) as p:
2024-07-06 02:13:44 | ERROR | stderr |     super().__init__(process_obj)
2024-07-06 02:13:44 | ERROR | stderr |   File "/data/niklas/arena/models.py", line 126, in retrieve
2024-07-06 02:13:44 | ERROR | stderr |     query_embed = model.encode([query])
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/site-packages/llm2vec/llm2vec.py", line 369, in encode
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 119, in Pool
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_fork.py", line 19, in __init__
2024-07-06 02:13:44 | ERROR | stderr |   File "/data/niklas/mteb/mteb/models/llm2vec_models.py", line 71, in encode
2024-07-06 02:13:44 | ERROR | stderr |     with cuda_compatible_multiprocess.Pool(num_proc) as p:
2024-07-06 02:13:44 | ERROR | stderr |     return Pool(processes, initializer, initargs, maxtasksperchild,
2024-07-06 02:13:44 | ERROR | stderr |     self._launch(process_obj)
2024-07-06 02:13:44 | ERROR | stderr |     return self.model.encode(sentences, **kwargs)
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 119, in Pool
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 215, in __init__
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 42, in _launch
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/site-packages/llm2vec/llm2vec.py", line 369, in encode
2024-07-06 02:13:44 | ERROR | stderr |     return Pool(processes, initializer, initargs, maxtasksperchild,
2024-07-06 02:13:44 | ERROR | stderr |     self._repopulate_pool()
2024-07-06 02:13:44 | ERROR | stderr |     prep_data = spawn.get_preparation_data(process_obj._name)
2024-07-06 02:13:44 | ERROR | stderr |     with cuda_compatible_multiprocess.Pool(num_proc) as p:
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 215, in __init__
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 306, in _repopulate_pool
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 154, in get_preparation_data
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 119, in Pool
2024-07-06 02:13:44 | ERROR | stderr |     self._repopulate_pool()
2024-07-06 02:13:44 | ERROR | stderr |     return self._repopulate_pool_static(self._ctx, self.Process,
2024-07-06 02:13:44 | ERROR | stderr |     _check_not_importing_main()
2024-07-06 02:13:44 | ERROR | stderr |     return Pool(processes, initializer, initargs, maxtasksperchild,
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 306, in _repopulate_pool
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 329, in _repopulate_pool_static
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 134, in _check_not_importing_main
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 215, in __init__
2024-07-06 02:13:44 | ERROR | stderr |     return self._repopulate_pool_static(self._ctx, self.Process,
2024-07-06 02:13:44 | ERROR | stderr |     w.start()
2024-07-06 02:13:44 | ERROR | stderr |     raise RuntimeError('''
2024-07-06 02:13:44 | ERROR | stderr |     self._repopulate_pool()
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 329, in _repopulate_pool_static
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/process.py", line 121, in start
2024-07-06 02:13:44 | ERROR | stderr | RuntimeError:
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 306, in _repopulate_pool
2024-07-06 02:13:44 | ERROR | stderr |     w.start()
2024-07-06 02:13:44 | ERROR | stderr |     self._popen = self._Popen(self)
2024-07-06 02:13:44 | ERROR | stderr |         An attempt has been made to start a new process before the
2024-07-06 02:13:44 | ERROR | stderr |     return self._repopulate_pool_static(self._ctx, self.Process,
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/process.py", line 121, in start
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 288, in _Popen
2024-07-06 02:13:44 | ERROR | stderr |         current process has finished its bootstrapping phase.
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/pool.py", line 329, in _repopulate_pool_static
2024-07-06 02:13:44 | ERROR | stderr |     self._popen = self._Popen(self)
2024-07-06 02:13:44 | ERROR | stderr |     return Popen(process_obj)
2024-07-06 02:13:44 | ERROR | stderr | 
2024-07-06 02:13:44 | ERROR | stderr |     w.start()
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 288, in _Popen
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 32, in __init__
2024-07-06 02:13:44 | ERROR | stderr |         This probably means that you are not using fork to start your
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/process.py", line 121, in start
2024-07-06 02:13:44 | ERROR | stderr |     return Popen(process_obj)
2024-07-06 02:13:44 | ERROR | stderr |     super().__init__(process_obj)
2024-07-06 02:13:44 | ERROR | stderr |         child processes and you have forgotten to use the proper idiom
2024-07-06 02:13:44 | ERROR | stderr |     self._popen = self._Popen(self)
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 32, in __init__
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_fork.py", line 19, in __init__
2024-07-06 02:13:44 | ERROR | stderr |         in the main module:
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/context.py", line 288, in _Popen
2024-07-06 02:13:44 | ERROR | stderr |     super().__init__(process_obj)
2024-07-06 02:13:44 | ERROR | stderr |     self._launch(process_obj)
2024-07-06 02:13:44 | ERROR | stderr | 
2024-07-06 02:13:44 | ERROR | stderr |     return Popen(process_obj)
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_fork.py", line 19, in __init__
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 42, in _launch
2024-07-06 02:13:44 | ERROR | stderr |             if __name__ == '__main__':
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 32, in __init__
2024-07-06 02:13:44 | ERROR | stderr |     self._launch(process_obj)
2024-07-06 02:13:44 | ERROR | stderr |     prep_data = spawn.get_preparation_data(process_obj._name)
2024-07-06 02:13:44 | ERROR | stderr |                 freeze_support()
2024-07-06 02:13:44 | ERROR | stderr |     super().__init__(process_obj)
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 42, in _launch
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 154, in get_preparation_data
2024-07-06 02:13:44 | ERROR | stderr |                 ...
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_fork.py", line 19, in __init__
2024-07-06 02:13:44 | ERROR | stderr |     prep_data = spawn.get_preparation_data(process_obj._name)
2024-07-06 02:13:44 | ERROR | stderr |     _check_not_importing_main()
2024-07-06 02:13:44 | ERROR | stderr | 
2024-07-06 02:13:44 | ERROR | stderr |     self._launch(process_obj)
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 154, in get_preparation_data
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 134, in _check_not_importing_main
2024-07-06 02:13:44 | ERROR | stderr |         The "freeze_support()" line can be omitted if the program
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/popen_spawn_posix.py", line 42, in _launch
2024-07-06 02:13:44 | ERROR | stderr |     _check_not_importing_main()
2024-07-06 02:13:44 | ERROR | stderr |     raise RuntimeError('''
2024-07-06 02:13:44 | ERROR | stderr |         is not going to be frozen to produce an executable.
2024-07-06 02:13:44 | ERROR | stderr |     prep_data = spawn.get_preparation_data(process_obj._name)
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 134, in _check_not_importing_main
2024-07-06 02:13:44 | ERROR | stderr | RuntimeError:
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 154, in get_preparation_data
2024-07-06 02:13:44 | ERROR | stderr |     raise RuntimeError('''
2024-07-06 02:13:44 | ERROR | stderr |         An attempt has been made to start a new process before the
2024-07-06 02:13:44 | ERROR | stderr |     _check_not_importing_main()
2024-07-06 02:13:44 | ERROR | stderr | RuntimeError:
2024-07-06 02:13:44 | ERROR | stderr |         current process has finished its bootstrapping phase.
2024-07-06 02:13:44 | ERROR | stderr |   File "/env/lib/conda/gritkto/lib/python3.10/multiprocessing/spawn.py", line 134, in _check_not_importing_main
2024-07-06 02:13:44 | ERROR | stderr |         An attempt has been made to start a new process before the
2024-07-06 02:13:44 | ERROR | stderr | 
2024-07-06 02:13:44 | ERROR | stderr |     raise RuntimeError('''
2024-07-06 02:13:44 | ERROR | stderr |         current process has finished its bootstrapping phase.
2024-07-06 02:13:44 | ERROR | stderr |         This probably means that you are not using fork to start your
2024-07-06 02:13:44 | ERROR | stderr | RuntimeError:
2024-07-06 02:13:44 | ERROR | stderr | 
2024-07-06 02:13:44 | ERROR | stderr |         child processes and you have forgotten to use the proper idiom
2024-07-06 02:13:44 | ERROR | stderr |         An attempt has been made to start a new process before the
2024-07-06 02:13:44 | ERROR | stderr |         This probably means that you are not using fork to start your
2024-07-06 02:13:44 | ERROR | stderr |         in the main module:
2024-07-06 02:13:44 | ERROR | stderr |         current process has finished its bootstrapping phase.
2024-07-06 02:13:44 | ERROR | stderr |         child processes and you have forgotten to use the proper idiom
2024-07-06 02:13:44 | ERROR | stderr | 
2024-07-06 02:13:44 | ERROR | stderr | 
2024-07-06 02:13:44 | ERROR | stderr |         in the main module:
2024-07-06 02:13:44 | ERROR | stderr |             if __name__ == '__main__':
2024-07-06 02:13:44 | ERROR | stderr |         This probably means that you are not using fork to start your
2024-07-06 02:13:44 | ERROR | stderr | 
2024-07-06 02:13:44 | ERROR | stderr |                 freeze_support()
2024-07-06 02:13:44 | ERROR | stderr |         child processes and you have forgotten to use the proper idiom
2024-07-06 02:13:44 | ERROR | stderr |             if __name__ == '__main__':
2024-07-06 02:13:44 | ERROR | stderr |                 ...
2024-07-06 02:13:44 | ERROR | stderr |         in the main module:
2024-07-06 02:13:44 | ERROR | stderr |                 freeze_support()
2024-07-06 02:13:44 | ERROR | stderr | 
2024-07-06 02:13:44 | ERROR | stderr | 
2024-07-06 02:13:44 | ERROR | stderr |                 ...
2024-07-06 02:13:44 | ERROR | stderr |         The "freeze_support()" line can be omitted if the program
2024-07-06 02:13:44 | ERROR | stderr |             if __name__ == '__main__':
2024-07-06 02:13:44 | ERROR | stderr | 
2024-07-06 02:13:44 | ERROR | stderr |         is not going to be frozen to produce an executable.
2024-07-06 02:13:44 | ERROR | stderr |                 freeze_support()
2024-07-06 02:13:44 | ERROR | stderr |         The "freeze_support()" line can be omitted if the program
2024-07-06 02:13:44 | ERROR | stderr |                 ...
2024-07-06 02:13:44 | ERROR | stderr |         is not going to be frozen to produce an executable.
2024-07-06 02:13:44 | ERROR | stderr | 
2024-07-06 02:13:44 | ERROR | stderr |         The "freeze_support()" line can be omitted if the program
2024-07-06 02:13:44 | ERROR | stderr |         is not going to be frozen to produce an executable.

[KennethEnevoldsen]

cc @vaibhavad