meltano / edk

Meltano extension development kit
https://edk.meltano.com
Apache License 2.0
10 stars 4 forks source link

Issue run matatika lab in windows #207

Open kevinkumar2020 opened 5 months ago

kevinkumar2020 commented 5 months ago

Try, to run matatika with meltano run matatika lab in windows it's throw error. meltano version 3.3

Traceback (most recent call last):
  File "C:\project\meltano-projects\meltano\my_project_feb\.meltano\utilities\matatika\venv\Lib\site-packages\meltano\edk\extension.py", line 134, in pass_through_invoker
    self.invoke(None, *command_args)
  File "C:\project\meltano-projects\meltano\my_project_feb\.meltano\utilities\matatika\venv\Lib\site-packages\matatika_ext\extension.py", line 69, in invoke   
    self.matatika_invoker.run_and_log(command_name, *command_args)
  File "C:\project\meltano-projects\meltano\my_project_feb\.meltano\utilities\matatika\venv\Lib\site-packages\matatika_ext\extension.py", line 39, in run_and_log
    return super().run_and_log(sub_command, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\project\meltano-projects\meltano\my_project_feb\.meltano\utilities\matatika\venv\Lib\site-packages\meltano\edk\process.py", line 179, in run_and_log
    result = asyncio.run(self._exec(sub_command, *args))
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Python311\Lib\asyncio\runners.py", line 190, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "C:\Python311\Lib\asyncio\runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Python311\Lib\asyncio\base_events.py", line 650, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "C:\project\meltano-projects\meltano\my_project_feb\.meltano\utilities\matatika\venv\Lib\site-packages\meltano\edk\process.py", line 137, in _exec      
    loop.add_signal_handler(
  File "C:\Python311\Lib\asyncio\events.py", line 574, in add_signal_handler
    raise NotImplementedError
NotImplementedError
invoke failed with uncaught exception, please report to maintainer
Traceback (most recent call last):
  File "C:\project\meltano-projects\meltano\my_project_feb\.meltano\utilities\matatika\venv\Lib\site-packages\meltano\edk\extension.py", line 134, in pass_through_invoker
    self.invoke(None, *command_args)
  File "C:\project\meltano-projects\meltano\my_project_feb\.meltano\utilities\matatika\venv\Lib\site-packages\matatika_ext\extension.py", line 69, in invoke   
    self.matatika_invoker.run_and_log(command_name, *command_args)
  File "C:\project\meltano-projects\meltano\my_project_feb\.meltano\utilities\matatika\venv\Lib\site-packages\matatika_ext\extension.py", line 39, in run_and_log
    return super().run_and_log(sub_command, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\project\meltano-projects\meltano\my_project_feb\.meltano\utilities\matatika\venv\Lib\site-packages\meltano\edk\process.py", line 179, in run_and_log    result = asyncio.run(self._exec(sub_command, *args))
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Python311\Lib\asyncio\runners.py", line 190, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "C:\Python311\Lib\asyncio\runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Python311\Lib\asyncio\base_events.py", line 650, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "C:\project\meltano-projects\meltano\my_project_feb\.meltano\utilities\matatika\venv\Lib\site-packages\meltano\edk\process.py", line 137, in _exec      
    loop.add_signal_handler(
  File "C:\Python311\Lib\asyncio\events.py", line 574, in add_signal_handler
    raise NotImplementedError
NotImplementedError
Exception ignored in: <function BaseSubprocessTransport.__del__ at 0x000002883F4FFB00>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\base_subprocess.py", line 126, in __del__
    self.close()
  File "C:\Python311\Lib\asyncio\base_subprocess.py", line 104, in close
    proto.pipe.close()
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 108, in close
    self._loop.call_soon(self._call_connection_lost, None)
  File "C:\Python311\Lib\asyncio\base_events.py", line 758, in call_soon
    self._check_closed()
  File "C:\Python311\Lib\asyncio\base_events.py", line 519, in _check_closed
    raise RuntimeError('Event loop is closed')
RuntimeError: Event loop is closed
Exception ignored in: <function _ProactorBasePipeTransport.__del__ at 0x000002883F535260>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 115, in __del__
    _warn(f"unclosed transport {self!r}", ResourceWarning, source=self)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 79, in __repr__
    info.append(f'fd={self._sock.fileno()}')
                      ^^^^^^^^^^^^^^^^^^^
  File "C:\Python311\Lib\asyncio\windows_utils.py", line 102, in fileno
    raise ValueError("I/O operation on closed pipe")
ValueError: I/O operation on closed pipe
Exception ignored in: <function _ProactorBasePipeTransport.__del__ at 0x000002883F535260>
Traceback (most recent call last):
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 115, in __del__
    _warn(f"unclosed transport {self!r}", ResourceWarning, source=self)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Python311\Lib\asyncio\proactor_events.py", line 79, in __repr__
    info.append(f'fd={self._sock.fileno()}')
                      ^^^^^^^^^^^^^^^^^^^
  File "C:\Python311\Lib\asyncio\windows_utils.py", line 102, in fileno
    raise ValueError("I/O operation on closed pipe")
ValueError: I/O operation on closed pipe
ReubenFrankel commented 4 months ago

Some more context:

https://docs.python.org/3/library/asyncio-platforms.html#windows

All event loops on Windows do not support the following methods:

  • loop.create_unix_connection() and loop.create_unix_server() are not supported. The [socket.AF](http://socket.AF)_UNIX socket family is specific to Unix.
  • loop.add_signal_handler() and loop.remove_signal_handler() are not supported

https://github.com/meltano/edk/blob/df18cb8431303f7c401c5c3611fba65f8fcead78/meltano/edk/process.py#L138-L141