singer-io / tap-harvest

A Singer tap for extracting data from the Harvest API
GNU Affero General Public License v3.0
8 stars 13 forks source link

Tap does not write all fields for certain streams to target #37

Open kspeer825 opened 4 years ago

kspeer825 commented 4 years ago

Expected: Tap-Harvest should send all fields for a given stream to the target, based on the V2 Harvest API. We are defining the expectations for which fields should be sent based on what is returned in the response of a get call to the Harvest API.

Actual: Tap-Harvest sends all fields for most streams with the following exceptions. Stream: fields roles: user_ids clients: statement_key invoices: recurring_invoice_id, period_start, paid_at, paid_date, closed_at, period_end estimates: declined_at, accepted_at time_entries: timer_started_at, rounded_hours

From this group the following fields were confirmed by warnings in the tap-tester logs. Stream: fields roles: user_ids clients: statement_key invoices: recurring_invoice_id

kspeer825 commented 4 years ago

The following appear to be a test issue, not a bug. These streams are not captured as a result of not creating the necessary data to: Stream: fields invoices: recurring_invoice_id, paid_at, paid_date, closed_at estimates: declined_at, accepted_at