Open visch opened 2 years ago
This has been marked as stale because it is unassigned, and has not had recent activity. It will be closed after 21 days if no further activity occurs. If this should never go stale, please add the evergreen
label, or request that it be added.
This has been marked as stale because it is unassigned, and has not had recent activity. It will be closed after 21 days if no further activity occurs. If this should never go stale, please add the evergreen
label, or request that it be added.
Feature scope
Targets (data type handling, batching, SQL object generation, etc.)
Description
Not sure if we want to make changes to the SDK but I wanted to document this somewhere publicly.
How to debug a Target written with the SDK.
Debugging is a bit tougher with targets for two reasons
poetry add remote-pdb
max_parallelism
in yourtarget.py
to only use 1 parallel job (ie no parallelization is used at all). ieexport PYTHONBREAKPOINT=remote_pdb.set_trace
,export REMOTE_PDB_QUIET=1
so no output from remote-pdb gets sent to the targetexport REMOTE_PDB_HOST=127.0.0.1
,export REMOTE_PDB_PORT=4444
,telnet 127.0.0.1 4444
breakpoint()
to set a breakpointThese commands are tweakable read through the documentation here https://pypi.org/project/remote-pdb/