Multiprocessing in python does not work with jupyter cell

[ignacio-rh]

Applies To

• [ ] Notebooks (.ipynb files)
• [X] Interactive Window and\/or Cell Scripts (.py files with #%% markers)

What happened?

Im trying to use python's multiprocessing on my mac's VScode. My script is pretty simple and shown below. I get the same behavior with simpler functions, but for some reason the "get_border_dist" function works when I do the pool.map()

But when I use the get_cdmx_dist() function, the pool map returns the strange error below.

This is all strange and Im not sure what to make of it.

#%%
"""
This just calculates the shortest distance from each muni 
to the border and CDMX. 
"""

import pandas as pd
pd.set_option('display.max_columns', None)
pd.set_option('display.max_rows', 500)

import geopandas as gpd
import sys
from pyprojroot import here
import graph_tool as gt 
from graph_tool.all import *
# adding toplevel dir to path. 
sys.path.append(str(here())) 
import config
import multiprocessing as mp

#%%
crs_meters = 'EPSG:6372'

roads_skinny = pd.read_stata(config.final_data + 'road_network.dta')
muni_unions = pd.read_stata(config.final_data + 'muni_unions.dta')
crossings = pd.read_stata(config.final_data + 'portsOfEntryUSMex.dta')

road_graph = Graph(directed = False)
# creating an external property
property = road_graph.new_edge_property("float")
# adding list of all properties 
eprops = [property]

#update opium_locals 
roads_skinny[['UNION_INI', 'UNION_FIN']] = roads_skinny[['UNION_INI', 'UNION_FIN']].astype(str)
e_list = roads_skinny[['UNION_INI', 'UNION_FIN', 'LONGITUD']].values.tolist()
# add edges and properties to the graph
vertex_ids = road_graph.add_edge_list(e_list, hashed = True , 
        hash_type = 'string', eprops = eprops)

cdmx = muni_unions.loc[muni_unions['cod_mun_05'].str[:2] == '09' , 'ID_UNION'].astype(int)

#%%

def get_cdmx_dist(union_id):
    return shortest_distance(road_graph, source =road_graph.vertex(union_id) ,
        target = cdmx, weights = property  ).min()

def get_border_dist(union_id):
    return shortest_distance(road_graph, source =road_graph.vertex(union_id) ,
        target = crossings['ID_UNION'], weights = property  ).min()

if __name__ == '__main__':    
    pool = mp.Pool(10)

    muni_unions['cdmx_dist_m'] =pool.map(
        get_border_dist , muni_unions['ID_UNION'].head(10).tolist()  )

#%%

VS Code Version

Version: 1.74.2 (Universal) Commit: e8a3071ea4344d9d48ef8a4df2c097372b0c5161 Date: 2022-12-20T10:26:09.430Z (2 wks ago) Electron: 19.1.8 Chromium: 102.0.5005.167 Node.js: 16.14.2 V8: 10.2.154.15-electron.0 OS: Darwin arm64 21.6.0 Sandboxed: No

Jupyter Extension Version

v2022.11.1003412109

Jupyter logs

Process SpawnPoolWorker-1:
Traceback (most recent call last):
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/pool.py", line 114, in worker
    task = get()
           ^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/queues.py", line 367, in get
    return _ForkingPickler.loads(res)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: Can't get attribute 'get_cdmx_dist' on <module '__mp_main__' from '/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py'>
Process SpawnPoolWorker-4:
Traceback (most recent call last):
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/pool.py", line 114, in worker
    task = get()
           ^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/queues.py", line 367, in get
    return _ForkingPickler.loads(res)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: Can't get attribute 'get_cdmx_dist' on <module '__mp_main__' from '/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py'>
Process SpawnPoolWorker-7:
Traceback (most recent call last):
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/pool.py", line 114, in worker
    task = get()
           ^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/queues.py", line 367, in get
    return _ForkingPickler.loads(res)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: Can't get attribute 'get_cdmx_dist' on <module '__mp_main__' from '/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py'>
Process SpawnPoolWorker-5:
Traceback (most recent call last):
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/pool.py", line 114, in worker
    task = get()
           ^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/queues.py", line 367, in get
    return _ForkingPickler.loads(res)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: Can't get attribute 'get_cdmx_dist' on <module '__mp_main__' from '/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py'>
Process SpawnPoolWorker-6:
Traceback (most recent call last):
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/pool.py", line 114, in worker
    task = get()
           ^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/queues.py", line 367, in get
    return _ForkingPickler.loads(res)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: Can't get attribute 'get_cdmx_dist' on <module '__mp_main__' from '/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py'>
Process SpawnPoolWorker-3:
Traceback (most recent call last):
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/pool.py", line 114, in worker
    task = get()
           ^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/queues.py", line 367, in get
    return _ForkingPickler.loads(res)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: Can't get attribute 'get_cdmx_dist' on <module '__mp_main__' from '/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py'>
Process SpawnPoolWorker-8:
Traceback (most recent call last):
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/pool.py", line 114, in worker
    task = get()
           ^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/queues.py", line 367, in get
    return _ForkingPickler.loads(res)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: Can't get attribute 'get_cdmx_dist' on <module '__mp_main__' from '/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py'>
Process SpawnPoolWorker-10:
Traceback (most recent call last):
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/pool.py", line 114, in worker
    task = get()
           ^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/queues.py", line 367, in get
    return _ForkingPickler.loads(res)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: Can't get attribute 'get_cdmx_dist' on <module '__mp_main__' from '/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py'>
Process SpawnPoolWorker-2:
Traceback (most recent call last):
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/pool.py", line 114, in worker
    task = get()
           ^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/queues.py", line 367, in get
    return _ForkingPickler.loads(res)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: Can't get attribute 'get_cdmx_dist' on <module '__mp_main__' from '/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py'>
Process SpawnPoolWorker-9:
Traceback (most recent call last):
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/pool.py", line 114, in worker
    task = get()
           ^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/queues.py", line 367, in get
    return _ForkingPickler.loads(res)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: Can't get attribute 'get_cdmx_dist' on <module '__mp_main__' from '/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py'>
in config
in config
in config
in config
in config
in config
in config
in config
in config
in config
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 120, in spawn_main
    exitcode = _main(fd, parent_sentinel)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 129, in _main
    prepare(preparation_data)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 240, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 291, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen runpy>", line 291, in run_path
  File "<frozen runpy>", line 98, in _run_module_code
  File "<frozen runpy>", line 88, in _run_code
  File "/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py", line 43, in <module>
    vertex_ids = road_graph.add_edge_list(e_list, hashed = True , 
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2507, in add_edge_list
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 120, in spawn_main
    exitcode = _main(fd, parent_sentinel)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 129, in _main
    prepare(preparation_data)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 240, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 291, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen runpy>", line 291, in run_path
  File "<frozen runpy>", line 98, in _run_module_code
  File "<frozen runpy>", line 88, in _run_code
  File "/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py", line 43, in <module>
    vertex_ids = road_graph.add_edge_list(e_list, hashed = True , 
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2507, in add_edge_list
    libcore.add_edge_list_hashed(self.__graph, edge_list,
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2493, in <genexpr>
    libcore.add_edge_list_hashed(self.__graph, edge_list,
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2493, in <genexpr>
    yield (val if i < 2 else convert[i - 2](val)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
KeyboardInterrupt
    yield (val if i < 2 else convert[i - 2](val)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
KeyboardInterrupt
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 120, in spawn_main
    exitcode = _main(fd, parent_sentinel)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 129, in _main
    prepare(preparation_data)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 240, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 291, in _fixup_main_from_path
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 120, in spawn_main
    main_content = runpy.run_path(main_path,
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen runpy>", line 291, in run_path
  File "<frozen runpy>", line 98, in _run_module_code
  File "<frozen runpy>", line 88, in _run_code
  File "/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py", line 43, in <module>
    vertex_ids = road_graph.add_edge_list(e_list, hashed = True , 
                 ^^^^^^^^^^^^^    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2507, in add_edge_list
    libcore.add_edge_list_hashed(self.__graph, edge_list,
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2493, in <genexpr>
exitcode = _main(fd, parent_sentinel)
    yield (val if i < 2 else convert[i - 2](val)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
KeyboardInterrupt
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 129, in _main
    prepare(preparation_data)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 240, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 291, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen runpy>", line 291, in run_path
  File "<frozen runpy>", line 98, in _run_module_code
  File "<frozen runpy>", line 88, in _run_code
  File "/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py", line 43, in <module>
    vertex_ids = road_graph.add_edge_list(e_list, hashed = True , 
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2507, in add_edge_list
    libcore.add_edge_list_hashed(self.__graph, edge_list,
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2493, in <genexpr>
    yield (val if i < 2 else convert[i - 2](val)
                             ^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 274, in convert
    def convert(val):

KeyboardInterrupt
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 120, in spawn_main
    exitcode = _main(fd, parent_sentinel)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 129, in _main
    prepare(preparation_data)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 240, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 291, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen runpy>", line 291, in run_path
  File "<frozen runpy>", line 98, in _run_module_code
  File "<frozen runpy>", line 88, in _run_code
  File "/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py", line 43, in <module>
    vertex_ids = road_graph.add_edge_list(e_list, hashed = True , 
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2507, in add_edge_list
    libcore.add_edge_list_hashed(self.__graph, edge_list,
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2493, in <genexpr>
    yield (val if i < 2 else convert[i - 2](val)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
KeyboardInterrupt
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 120, in spawn_main
    exitcode = _main(fd, parent_sentinel)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 129, in _main
    prepare(preparation_data)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 240, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 291, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen runpy>", line 291, in run_path
  File "<frozen runpy>", line 98, in _run_module_code
  File "<frozen runpy>", line 88, in _run_code
  File "/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py", line 43, in <module>
    vertex_ids = road_graph.add_edge_list(e_list, hashed = True , 
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2507, in add_edge_list
    libcore.add_edge_list_hashed(self.__graph, edge_list,
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2493, in <genexpr>
    yield (val if i < 2 else convert[i - 2](val)
                             ^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 274, in convert
    def convert(val):

KeyboardInterrupt
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 120, in spawn_main
    exitcode = _main(fd, parent_sentinel)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 129, in _main
    prepare(preparation_data)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 240, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 291, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen runpy>", line 291, in run_path
  File "<frozen runpy>", line 98, in _run_module_code
  File "<frozen runpy>", line 88, in _run_code
  File "/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py", line 43, in <module>
    vertex_ids = road_graph.add_edge_list(e_list, hashed = True , 
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2507, in add_edge_list
    libcore.add_edge_list_hashed(self.__graph, edge_list,
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2493, in <genexpr>
    yield (val if i < 2 else convert[i - 2](val)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
KeyboardInterrupt
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 120, in spawn_main
    exitcode = _main(fd, parent_sentinel)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 129, in _main
    prepare(preparation_data)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 240, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 291, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen runpy>", line 291, in run_path
  File "<frozen runpy>", line 98, in _run_module_code
  File "<frozen runpy>", line 88, in _run_code
  File "/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py", line 43, in <module>
    vertex_ids = road_graph.add_edge_list(e_list, hashed = True , 
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2507, in add_edge_list
    libcore.add_edge_list_hashed(self.__graph, edge_list,
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2494, in wrap
    for (i, val) in enumerate(row)
                    ^^^^^^^^^^^^^^
KeyboardInterrupt
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 120, in spawn_main
    exitcode = _main(fd, parent_sentinel)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 129, in _main
    prepare(preparation_data)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 240, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 291, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen runpy>", line 291, in run_path
  File "<frozen runpy>", line 98, in _run_module_code
  File "<frozen runpy>", line 88, in _run_code
  File "/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py", line 43, in <module>
    vertex_ids = road_graph.add_edge_list(e_list, hashed = True , 
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2507, in add_edge_list
    libcore.add_edge_list_hashed(self.__graph, edge_list,
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2493, in <genexpr>
    yield (val if i < 2 else convert[i - 2](val)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
KeyboardInterrupt
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 120, in spawn_main
    exitcode = _main(fd, parent_sentinel)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 129, in _main
    prepare(preparation_data)
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 240, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/multiprocessing/spawn.py", line 291, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen runpy>", line 291, in run_path
  File "<frozen runpy>", line 98, in _run_module_code
  File "<frozen runpy>", line 88, in _run_code
  File "/Users/ignacio/Documents/mexico_cartel_entry/cleaning_data/clean_distances_to_US/calculate_muni_distances_border.py", line 43, in <module>
    vertex_ids = road_graph.add_edge_list(e_list, hashed = True , 
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2507, in add_edge_list
    libcore.add_edge_list_hashed(self.__graph, edge_list,
  File "/Users/ignacio/mambaforge/envs/metrics/lib/python3.11/site-packages/graph_tool/__init__.py", line 2493, in <genexpr>
    yield (val if i < 2 else convert[i - 2](val)

KeyboardInterrupt

Coding Language and Runtime Version

python 3.11.0

Language Extension Version (if applicable)

Python Extension

Anaconda Version (if applicable)

mambaforge

Running Jupyter locally or remotely?

Local

[DonJayamanne]

@ignacio-rh Sorry you are running into this issue and thanks for filing this issue. can you try running the exact same code in Jupyter notebook Please let me know how that goes, if it still fails does it fail with the same error message (if not please could you provide that output)

[ignacio-rh]

Hi,

I copied the exact same code into a new jupyter notebook, into a self contained cell. Im attaching the errors I got., and the notebook.

error_log.txt test.ipynb.zip

Please let me know if any more info from me would help.

Best Ignacio

[DonJayamanne]

Thanks for getting back, as suspected you are running into this issue outside vscode as well. Meaning this isn't a problem with the jupyter extension in vscode. Unfortunately i do not know why it is failing, i would suggest trying stack overflow or some similar community (github etc) to determine the cause Once again the problem exists outside of vscode, hence closing this issue.

Sorry I could not be of any further assistance

[ignacio-rh]

Hi Don,

No worries, in fact thank you. I now realize the problem is likely something with my mac or something else.

Thanks! Ignacio