artefactory / artefactory-connectors-kit

ACK is an E(T)L tool specialized in API data ingestion. It is accessible through a Command-Line Interface. The application allows you to easily extract, stream and load data (with minimum transformations), from the API source to the destination of your choice.
GNU Lesser General Public License v3.0
42 stars 6 forks source link
adobe-analytics amazon-s3 api confluence dcm dv360 facebook google-ads google-analytics google-cloud-storage google-sheets mysql mytarget radarly salesforce search-console the-trade-desk twitter yandex

Artefactory Connectors Kit

ACK is an E(T)L tool specialized in API data ingestion. It is accessible through a Command-Line Interface. The application allows you to easily extract, stream and load data (with minimum transformations), from the API source to the destination of your choice.

As of now, the most common output format of data loaded by the application is .njson (i.e. a file of n lines, where each line is a json-like dictionary).

Official documentation is available here.


Philosophy

The application is composed of 3 main components (implemented as Python classes). When combined, these components act as an E(T)L pipeline, allowing you to stream data from a source to the destination of your choice:

Why not Airbyte ?

Airbyte is an open source project that has a mission to make data integration pipelines a commodity. We love this project and would probably not encourage using ACK to connect data that could be already connected with Airbyte. You can still use ACK if some of your data has no connector available in Airbyte yet. The list of connectors unavailable in Airbyte will most certainly decrease over time following the introduction of the Python Connector Development Kit.

Available connectors

As of now, the application is offering the following Readers & Writers:

Readers

Writers