search

codedownio / julia2nix

Generate Nix expressions for building a Julia depot with a set of packages
53 stars 6 forks source link

Python multiprocessing can hang on MacOS #9

Closed idontgetoutmuch closed 2 years ago

idontgetoutmuch commented 3 years ago

It's been running for many minutes now. Does this happen just the first time or every time you update the packages?

idontgetoutmuch commented 3 years ago 
~/julia2nix/julia2nix
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpmf433q9q/registry
Got registry revision 8312363fa1d07a397f8f2ec153a2af1d5ad353d8
Got registry sha256 0h68r96gdbv0a5nimz250zg2nx6fdf0m3wzwqlcbskr38rv416kv
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmp6gjitunb/registry
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpqndrpa7v/registry
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpvcpnrape/registry
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmp__fn3y4i/registry
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmp6z61tfdf/registry
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmptvu1kdlo/registry
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpfgki6e9g/registry
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpgzg843ip/registry
Got registry revision 8312363fa1d07a397f8f2ec153a2af1d5ad353d8
Got registry revision 8312363fa1d07a397f8f2ec153a2af1d5ad353d8
Got registry revision 8312363fa1d07a397f8f2ec153a2af1d5ad353d8
Got registry revision 8312363fa1d07a397f8f2ec153a2af1d5ad353d8
Got registry sha256 0h68r96gdbv0a5nimz250zg2nx6fdf0m3wzwqlcbskr38rv416kv
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpkpo9xw12/registry
Got registry sha256 0h68r96gdbv0a5nimz250zg2nx6fdf0m3wzwqlcbskr38rv416kv
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpekx5xpv7/registry
Got registry revision 8312363fa1d07a397f8f2ec153a2af1d5ad353d8
Got registry revision 8312363fa1d07a397f8f2ec153a2af1d5ad353d8
Got registry revision 8312363fa1d07a397f8f2ec153a2af1d5ad353d8
Got registry sha256 0h68r96gdbv0a5nimz250zg2nx6fdf0m3wzwqlcbskr38rv416kv
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpgw5x9h93/registry
Got registry revision 8312363fa1d07a397f8f2ec153a2af1d5ad353d8
Got registry revision f906c14ea1b3f19677bf95ca80e4fe9f9a582614
Got registry revision f906c14ea1b3f19677bf95ca80e4fe9f9a582614
Got registry sha256 0h68r96gdbv0a5nimz250zg2nx6fdf0m3wzwqlcbskr38rv416kv
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmp_g2gn9xj/registry
Got registry sha256 01jrdma0nl21n7hp8phinkywwpg7x0hj4gxi5wksiyarc8ig5xlp
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmp75dyrb86/registry
Got registry sha256 01jrdma0nl21n7hp8phinkywwpg7x0hj4gxi5wksiyarc8ig5xlp
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmp4d4jloub/registry
Got registry sha256 0h68r96gdbv0a5nimz250zg2nx6fdf0m3wzwqlcbskr38rv416kv
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpjfityfrp/registry
Got registry sha256 0h68r96gdbv0a5nimz250zg2nx6fdf0m3wzwqlcbskr38rv416kv
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpfuy7sx0b/registry
Got registry revision e23d4dbe6fb4d2933a3ff8521e2a6dc380b96bce
Got registry revision e23d4dbe6fb4d2933a3ff8521e2a6dc380b96bce
Got registry revision e23d4dbe6fb4d2933a3ff8521e2a6dc380b96bce
Got registry sha256 0sfsg0m3scdx5mq82k6385gxh54i3w0hj79rdfrla424zrwgybaf
Got registry revision f906c14ea1b3f19677bf95ca80e4fe9f9a582614
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpzm7txwr0/registry
Got registry sha256 0sfsg0m3scdx5mq82k6385gxh54i3w0hj79rdfrla424zrwgybaf
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmp4c96je7l/registry
Got registry sha256 0sfsg0m3scdx5mq82k6385gxh54i3w0hj79rdfrla424zrwgybaf
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpym5rdagg/registry
Got registry sha256 0h68r96gdbv0a5nimz250zg2nx6fdf0m3wzwqlcbskr38rv416kv
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpnb40kyi5/registry
Got registry revision e23d4dbe6fb4d2933a3ff8521e2a6dc380b96bce
Got registry revision e23d4dbe6fb4d2933a3ff8521e2a6dc380b96bce
Got registry sha256 0sfsg0m3scdx5mq82k6385gxh54i3w0hj79rdfrla424zrwgybaf
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpd1kevfec/registry
Got registry revision e23d4dbe6fb4d2933a3ff8521e2a6dc380b96bce
Got registry sha256 0sfsg0m3scdx5mq82k6385gxh54i3w0hj79rdfrla424zrwgybaf
Got registry sha256 0h68r96gdbv0a5nimz250zg2nx6fdf0m3wzwqlcbskr38rv416kv
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmph7cwt9re/registry
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpd7mhc2zk/registry
Got registry sha256 0sfsg0m3scdx5mq82k6385gxh54i3w0hj79rdfrla424zrwgybaf
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpa6nep15b/registry
Got registry sha256 01jrdma0nl21n7hp8phinkywwpg7x0hj4gxi5wksiyarc8ig5xlp
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 106, in <module>
    with Pool(num_workers) as p:
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError: 
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpi1sd8coj/registry
idontgetoutmuch commented 3 years ago

I've now killed it (after > 20 minutes)

idontgetoutmuch commented 3 years ago

This seems related: https://github.com/thomasjm/julia2nix/issues/5 but I would be very happy with a minute - I can try again and leave it running for an hour

idontgetoutmuch commented 3 years ago

I left it running for 2 hours and then killed it

thomasjm commented 3 years ago

That's far too long, looks like it's crashing. What happens if you pass --workers 1 ?

thomasjm commented 3 years ago

Oh, are you on Windows? If so I think I see the problem and will push a fix later today.

thomasjm commented 3 years ago

I just pushed a commit that will hopefully fix it, can you git pull and try again?

idontgetoutmuch commented 3 years ago

I should have said that I am on macos (big sur)

idontgetoutmuch commented 3 years ago

I just pushed a commit that will hopefully fix it, can you git pull and try again?

Still getting the same errors - I am trying with --workers 1

BTW I patched the julia derivation to build on macos (it took many hours): https://github.com/NixOS/nixpkgs/pull/114855/files

idontgetoutmuch commented 3 years ago

With --workers 1 I get the same error 

git log --oneline -1
3beb210 (HEAD -> main, origin/main, origin/HEAD) Wrap julia2nix script in a main function to hopefully fix #9
idontgetoutmuch commented 3 years ago

I know very little about python but similar problems have been reported: https://stackoverflow.com/questions/60691363/runtimeerrorfreeze-support-on-mac

idontgetoutmuch commented 3 years ago 
    if __name__ == "__main__":
        with Pool(num_workers) as p:
            formatted_dicts = p.map(process_item, manifest.keys())

gives different errors

NameError: name 'formatted_dicts' is not defined
Cloning https://github.com/JuliaRegistries/General.git to /tmp/tmpjihreazn/registry
Got registry sha256 0zqk82f2pgqij6q2l473n491n0j7nr5zw10prhqmszjdd1n9srbc
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 125, in _main
    prepare(preparation_data)
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/multiprocessing/spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "/nix/store/b3mgl5x2233qddyh3rfdss7ngzwa8bgq-python3-3.8.5/lib/python3.8/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/Users/dom/julia2nix/gather_packages.py", line 120, in <module>
    " ".join(['"' + x + '"' for x in root_packages]), " ".join(formatted_dicts)))
idontgetoutmuch commented 3 years ago

This produced a packages.nix

diff --git a/extract_artifacts.jl b/extract_artifacts.jl
index 1b5d0d8..b3067a0 100755
--- a/extract_artifacts.jl
+++ b/extract_artifacts.jl
@@ -1,5 +1,5 @@
 #! /usr/bin/env nix-shell
-#! nix-shell -i julia -p julia_15
+#! nix-shell -i julia -I nixpkgs=/Users/dom/nixpkgs

 using Pkg, Pkg.Artifacts, Pkg.BinaryPlatforms, Pkg.PlatformEngines

diff --git a/gather_packages.py b/gather_packages.py
index adf84a5..9afa746 100755
--- a/gather_packages.py
+++ b/gather_packages.py
@@ -103,8 +103,7 @@ with tempfile.TemporaryDirectory() as working_dir:
                               f'src = {src};']) \
                + "\n}"

-    with Pool(num_workers) as p:
-        formatted_dicts = p.map(process_item, manifest.keys())
+    formatted_dicts = map(process_item, manifest.keys())

     print("""# This file is autogenerated, do not edit by hand!
 {fetchgit}: {
thomasjm commented 3 years ago

Oh sorry, I forgot there's a second Python script that needs a main function also. I just pushed a commit to convert gather_packages.py, which should be equivalent to your second change.

For your first change above, you should be able to just do export NIX_PATH=nixpkgs=/Users/dom/nixpkgs in your shell.

idontgetoutmuch commented 3 years ago

With

nix-shell -I nixpkgs=/Users/dom/nixpkgs default.nix

I seem to be rebuilding julia :(

OTOH this 

nix-shell -I nixpkgs=/Users/dom/nixpkgs shell.nix

just uses the julia I built yesterday

{ pkgs ? import <nixpkgs> { config.allowBroken = true; } }:

let

  julia = pkgs.julia_15.override {
    # stdenv = pkgs.overrideCC pkgs.stdenv pkgs.gcc;
    blas = pkgs.openblas;
  };

in

pkgs.mkShell {
  buildInputs = [
    julia
  ];

  MYVARIABLE = "hello";
}
thomasjm commented 3 years ago

Setting NIX_PATH like I suggested should work for default.nix

idontgetoutmuch commented 3 years ago

That's what I thought and I cleared out my channels

dom@MacBook-Pro depot % nix-channel --list
nix-channel --list
dom@MacBook-Pro depot %

and if I try

dom@MacBook-Pro depot % nix-shell default.nix
nix-shell default.nix
error: file 'nixpkgs' was not found in the Nix search path (add it using $NIX_PATH or -I), at /Users/dom/Dropbox/Tidy/depot/default.nix:1:13

but

dom@MacBook-Pro depot % export NIX_PATH=nixpkgs=/Users/dom/nixpkgs
export NIX_PATH=nixpkgs=/Users/dom/nixpkgs
dom@MacBook-Pro depot % nix-shell default.nix
nix-shell default.nix
trace: Warning: `stdenv.lib` is deprecated and will be removed in the next release. Please use `lib` instead. For more information see https://github.com/NixOS/nixpkgs/issues/108938
these derivations will be built:
  /nix/store/k5h6p3d1w1ilp4b8b7s38bd2pb1yd4sl-julia-1.5.3.drv
  /nix/store/k14gh5m1pnxdn1c5xz87nwmck0593mqk-julia-wrapped.drv
  /nix/store/2332d6kgvqhy3qi6b0aqjrn9jjvsvbyg-julia-depot.drv
building '/nix/store/k5h6p3d1w1ilp4b8b7s38bd2pb1yd4sl-julia-1.5.3.drv'...
thomasjm commented 3 years ago

Hmm, can you try following the instructions for this package exactly? They don't say to use nix-shell. (Adding a shell.nix to the generated files might be a good feature though, if we could make it drop you into Julia...)

I notice that with the change you made to extract_artifacts.jl, you're building the default julia for whatever Nixpkgs checkout you have. It's possible that's not the same as julia-1.5.3, which would be why you're seeing a rebuild.

idontgetoutmuch commented 3 years ago

I found my error: in shell.nix I have an extra blas = pkgs.openblas;.

thomasjm commented 3 years ago

Sounds good -- I'm just going to keep this issue open to track the multiprocessing issue, since I had to revert one of the commits dealing with that.

idontgetoutmuch commented 3 years ago

It's still not working - I tried c078539 - it works without multiprocessing (with my patch).

thomasjm commented 2 years ago

Tidying up issues, I'm going to close this because Julia on MacOS is not supported on Nixpkgs right now. Let's revisit if/when MacOS becomes supported, and then I'll start running it in CI.