The validation step checks that are required args are set and that no unkown ones are present, but lacks to smarts to understand variable *args and **kwargs. For example:
def fun(a, **kwargs):
return a
task = PipelineTask('task', fun)
task.validate({})
errors with
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/Users/arik/ws/ssec/dplutils/dplutils/pipeline/task.py", line 87, in validate
raise ValueError(msg)
ValueError: missing required argument kwargs for task task
which clearly is not correct.
One issue is inspect.signature parameters dont indicate these variadic parameters. Prob replace with inspect.getfulargspec.
The validation step checks that are required args are set and that no unkown ones are present, but lacks to smarts to understand variable *args and **kwargs. For example:
errors with
which clearly is not correct.
One issue is
inspect.signature
parameters dont indicate these variadic parameters. Prob replace withinspect.getfulargspec
.