[feat][s] Fixing payload encoding for GCP request

datopian / ckanext-aircan

The custom extension for notifying(triggering) the Airflow DAG about the data to be uploaded to DataStore

GNU Affero General Public License v3.0

6 stars 5 forks source link

[feat][s] Fixing payload encoding for GCP request #6

Closed hannelita closed 4 years ago

hannelita commented 4 years ago

Relates to https://github.com/datopian/aircan/pull/53; still a WIP (another PR is in progress). This PR just splits JSON payload that is created in the case of a local Airflow instance or in the case of a GCP Airflow instance.

hannelita commented 4 years ago

CLOSING this PR. As specified in https://github.com/datopian/aircan/issues/1, we will not have any kind of async interaction where the remote Airflow hits CKAN to inform the status of the processing. Instead, the remote Airflow, if it succeeds, will send the processed JSON via API. No error handling in this milestone.