The GCSToGCSOperator is throwing an error when trying to pass task output into the source_objects field.
File "/usr/local/lib/python3.11/site-packages/airflow/providers/google/cloud/transfers/gcs_to_gcs.py", line 211, in __init__
if source_objects and any(WILDCARD in obj for obj in source_objects):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/airflow/models/xcom_arg.py", line 268, in __iter__
raise TypeError("'XComArg' object is not iterable")
What you think should happen instead
This operator should be able to handle xcom, and we have no issue using the GCSToBigQueryOperator in the same way
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
Apache Airflow Provider(s)
google
Versions of Apache Airflow Providers
10.15.0
Apache Airflow version
2.7.3
Operating System
debian
Deployment
Astronomer
Deployment details
Using astro runtime 9.15.0
What happened
The GCSToGCSOperator is throwing an error when trying to pass task output into the
source_objects
field.What you think should happen instead
This operator should be able to handle xcom, and we have no issue using the
GCSToBigQueryOperator
in the same wayHow to reproduce
Anything else
No response
Are you willing to submit PR?
Code of Conduct