search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.28k stars 4.15k forks source link

Source Mailjet Mail: fill the streams with data #24570

Closed igrankova closed 1 year ago

igrankova commented 1 year ago

Tell us about the problem you're trying to solve

Seed the streams. Requirements:

igrankova commented 1 year ago

LastPass: Mailjet Mail + SMS Sandbox Account

igrankova commented 1 year ago

Seeding results file

igrankova commented 1 year ago

The Campaigns stream https://api.mailjet.com/v3/REST/campaign doesn't retrieve data without setting up the parameter FromTS [Both Unix timestamp (e.g. 1514764800) and RFC3339 (2018-01-01T00:00:00) formats are accepted] (the start date from the Campaign was created), without this parameter only campaigns that were created today are retrieved. We need to update the code accordingly, maybe we can add a required field to the source setup.

igrankova commented 1 year ago

Seeded 5 from 5 streams, records count 82%, quality 96%. stats_api_lifetime_message stream is seeded by 1 record only, probably for one API Key there's only one record - the summary statistics for the API Key: Get aggregated statistics for a specific campaign, list, API Key or sender email address. Both message-based and event-based stats can be retrieved. Our connector retrieves data for the API Key: /statcounters?CounterSource=APIKey&CounterResolution=Lifetime&CounterTiming=Message