search

singer-io / tap-outreach

GNU Affero General Public License v3.0
6 stars 21 forks source link

0 rows replicated for 'mailings' table #17

Open eestack opened 2 years ago

eestack commented 2 years ago

0 rows are being replicated for my 'mailings' table, even though there are certainly rows there. Log is below- issue in bold. Any help is appreciated!

2022-02-14 11:30:16,472Z main - INFO Running tap-outreach version 0.7.0 and target-stitch version 3.2.0 2022-02-14 11:30:17,638Z main - INFO [smart-services] building smart service producer: topic( com.stitchdata.extractionJobStarted ), use_ssl( true ) 2022-02-14 11:30:17,641Z main - INFO [smart-services] building smart service producer: topic( com.stitchdata.extractionJobFinished ), use_ssl( true ) 2022-02-14 11:30:17,642Z main - INFO [smart-services] building smart service producer: topic( com.stitchdata.streamRecordCount ), use_ssl( true ) 2022-02-14 11:30:18,286Z main - INFO [smart-services] event successfully sent to kafka: com.stitchdata.extractionJobStarted [10] at offset None 2022-02-14 11:30:18,289Z main - INFO Starting tap to discover schemas: tap-env/bin/tap-outreach --config /tmp/tap_discover_config.json --discover 2022-02-14 11:30:18,502Z main - INFO Tap exited normally. 2022-02-14 11:30:18,506Z main - INFO Saving list of discovered streams 2022-02-14 11:30:18,574Z main - INFO Saving structure of stream calls (tap_stream_id: calls) 2022-02-14 11:30:18,673Z main - INFO Saving structure of stream events (tap_stream_id: events) 2022-02-14 11:30:18,711Z main - INFO Saving structure of stream prospects (tap_stream_id: prospects) 2022-02-14 11:30:18,794Z main - INFO Saving structure of stream call_dispositions (tap_stream_id: call_dispositions) 2022-02-14 11:30:18,869Z main - INFO Saving structure of stream users (tap_stream_id: users) 2022-02-14 11:30:18,914Z main - INFO Saving structure of stream content_categories (tap_stream_id: content_categories) 2022-02-14 11:30:18,969Z main - INFO Saving structure of stream sequences (tap_stream_id: sequences) 2022-02-14 11:30:19,012Z main - INFO Saving structure of stream tasks (tap_stream_id: tasks) 2022-02-14 11:30:19,082Z main - INFO Saving structure of stream call_purposes (tap_stream_id: call_purposes) 2022-02-14 11:30:19,106Z main - INFO Saving structure of stream duties (tap_stream_id: duties) 2022-02-14 11:30:19,132Z main - INFO Saving structure of stream sequence_templates (tap_stream_id: sequence_templates) 2022-02-14 11:30:19,169Z main - INFO Saving structure of stream stages (tap_stream_id: stages) 2022-02-14 11:30:19,185Z main - INFO Saving structure of stream sequence_states (tap_stream_id: sequence_states) 2022-02-14 11:30:19,222Z main - INFO Saving structure of stream personas (tap_stream_id: personas) 2022-02-14 11:30:19,244Z main - INFO Saving structure of stream teams (tap_stream_id: teams) 2022-02-14 11:30:19,267Z main - INFO Saving structure of stream mailings (tap_stream_id: mailings) 2022-02-14 11:30:19,316Z main - INFO Saving structure of stream mailboxes (tap_stream_id: mailboxes) 2022-02-14 11:30:19,358Z main - INFO Saving structure of stream accounts (tap_stream_id: accounts) 2022-02-14 11:30:19,410Z main - INFO Saving structure of stream opportunities (tap_stream_id: opportunities) 2022-02-14 11:30:19,504Z main - INFO Saving structure of stream sequence_steps (tap_stream_id: sequence_steps) 2022-02-14 11:30:20,364Z main - INFO Writing catalog to file 2022-02-14 11:30:20,422Z main - INFO Selected fields for stream mailings: followUpTaskScheduledAt, subject, retryInterval, clickedAt, references, createdAt, mailboxAddress, sequenceStateId, clickCount, repliedAt, messageId, opportunityId, trackOpens, updatedAt, id, errorReason, sequenceId, mailboxId, retryCount, overrideSafetySettings, sequenceStepId, bodyText, bodyHtml, unsubscribedAt, notifyThreadScheduledAt, markedAsSpamAt, prospectId, trackLinks, openedAt, openCount, taskId, scheduledAt, deliveredAt, stateChangedAt, templateId, retryAt, followUpTaskType, calendarId, state, notifyThreadCondition, mailingType, bouncedAt, notifyThreadStatus, errorBacktrace 2022-02-14 11:30:20,422Z main - INFO Selected fields for stream sequence_states: callCompletedAt, positiveReplyCount, negativeReplyCount, optOutCount, prospectId, createdAt, bounceCount, accountId, activeAt, openCount, clickCount, stateChangedAt, scheduleCount, errorReason, deliverCount, updatedAt, id, failureCount, state, naturalReplyCount, pauseReason, sequenceId, creatorId, repliedAt, replyCount 2022-02-14 11:30:20,422Z main - INFO Selected fields for stream sequences: lastUsedAt, positiveReplyCount, throttleMaxAddsPerDay, optOutCount, createdAt, bounceCount, clickCount, ownerId, scheduleCount, deliverCount, description, negativeReplyCount, id, secondaryReplyPauseDuration, maxActivations, primaryReplyPauseDuration, creatorId, secondaryReplyAction, throttlePausedAt, neutralReplyCount, numContactedProspects, name, updaterId, primaryReplyAction, scheduleIntervalType, lockedAt, durationInDays, automationPercentage, replyCount, sequenceType, locked, openCount, failureCount, sequenceStepCount, shareType, throttlePaused, enabled, updatedAt, transactional, enabledAt, numRepliedProspects, tags, throttleCapacity, finishOnReply 2022-02-14 11:30:20,422Z main - INFO Selected fields for stream sequence_steps: stepType, positiveReplyCount, taskNote, negativeReplyCount, optOutCount, updaterId, createdAt, order, openCount, date, clickCount, scheduleCount, deliverCount, updatedAt, id, failureCount, bounceCount, sequenceId, interval, taskAutoskipDelay, creatorId, displayName, neutralReplyCount, replyCount 2022-02-14 11:30:20,422Z main - INFO Selected fields for stream prospects: mobilePhones, custom11, firstName, custom39, campaignName, websiteUrl1, custom47, createdAt, accountId, facebookUrl, custom12, custom20, custom35, custom24, custom10, smsOptedOut, updatedAt, updaterId, custom8, custom15, addressCountry, creatorId, timeZoneInferred, custom45, personalNote2, callOptedOut, custom2, custom26, school, workPhones, twitterUrl, custom16, name, emailsOptStatus, custom17, websiteUrl3, linkedInSlug, addressStreet, homePhones, twitterUsername, custom31, custom5, custom55, custom1, timeZone, personalNote1, defaultPluginMappingId, custom29, ownerId, custom52, optedOut, custom41, custom30, custom51, githubUrl, custom13, custom33, custom37, engagedScore, custom54, googlePlusUrl, custom25, voipPhones, stageId, tags, gender, preferredContact, custom21, custom43, emailOptedOut, occupation, linkedInUrl, clickCount, custom44, custom50, linkedInConnections, emailsOptedAt, degree, custom46, touchedAt, engagedAt, websiteUrl2, quoraUrl, specialties, custom6, custom14, title, emails, externalSource, custom32, smsOptedAt, lastName, custom22, addressCity, custom38, addressStreet2, addressState, custom42, custom19, callsOptedAt, optedOutAt, custom28, custom3, graduationDate, externalId, otherPhones, score, custom7, contactHistogram, addedAt, callsOptStatus, id, stackOverflowId, personaId, openCount, nickname, githubUsername, custom48, timeZoneIana, custom4, replyCount, middleName, dateOfBirth, custom27, custom49, addressZip, custom36, custom34, externalOwner, custom23, source, custom53, jobStartDate, linkedInId, custom40, availableAt, custom18, stackOverflowUrl, smsOptStatus, angelListUrl, custom9, eventName, region 2022-02-14 11:30:20,422Z main - INFO Selected fields for stream tasks: mailingId, completed, callId, action, completerId, prospectId, autoskipAt, taskType, createdAt, templateId, taskPriorityId, completedAt, subjectId, stateChangedAt, note, dueAt, opportunityId, updatedAt, id, state, ownerId, compiledSequenceTemplateHtml, sequenceId, creatorId, accountId, sequenceStateId, sequenceStepId, scheduledAt, taskThemeId 2022-02-14 11:30:20,422Z main - INFO Selected fields for stream calls: callPurposeId, returnedAt, prospectId, recordingUrl, answeredAt, stateChangedAt, createdAt, taskId, to, completedAt, sequenceStateId, from, note, opportunityId, outcome, updatedAt, id, state, sequenceAction, tags, sequenceId, callDispositionId, voicemailRecordingUrl, userCallType, sequenceStepId, userId, direction 2022-02-14 11:30:20,422Z main - INFO Selected fields for stream call_dispositions: createdAt, order, id, outcome, name, creatorId, updatedAt 2022-02-14 11:30:20,426Z main - INFO Current state: {"currently_syncing": null, "bookmarks": {"mailings": "2021-01-13T00:00:00Z", "sequence_states": "2022-02-13T11:30:44.000Z", "sequences": "2022-02-13T11:18:29.000Z", "sequence_steps": "2022-02-13T09:50:40.000Z", "events": "2021-03-14T21:21:37.000Z", "prospects": "2022-02-13T11:30:34.000Z", "tasks": "2022-02-13T11:15:58.000Z", "calls": "2022-02-12T18:51:31.000Z", "call_dispositions": "2021-12-14T19:12:40.000Z"}} 2022-02-14 11:30:20,427Z main - INFO Starting tap: tap-env/bin/tap-outreach --config /tmp/tap_config.json --properties /tmp/properties.json --catalog /tmp/catalog.json --state /tmp/tap_state.json 2022-02-14 11:30:20,431Z main - INFO Starting target: target-env/bin/target-stitch --config /tmp/target_config.json 2022-02-14 11:30:20,601Z tap - INFO Testing authentication 2022-02-14 11:30:20,943Z target - INFO Using batch_size_prefernces of {'batch_size_preference': None, 'user_batch_size_preference': None, 'full_table_streams': []} 2022-02-14 11:30:20,953Z tap - INFO METRIC Point(metric_type='timer', metric='http_request_duration', value=0.34778928756713867, tags={'status': 'succeeded', 'http_status_code': 200}) 2022-02-14 11:30:24,211Z tap - INFO HTTP request to "stages" endpoint took 3.261s, returned status code 200 2022-02-14 11:30:24,212Z tap - INFO Skipping stream: events 2022-02-14 11:30:24,212Z tap - INFO Skipping stream: users 2022-02-14 11:30:24,212Z tap - INFO Skipping stream: content_categories 2022-02-14 11:30:24,212Z tap - INFO Skipping stream: call_purposes 2022-02-14 11:30:24,212Z tap - INFO Skipping stream: duties 2022-02-14 11:30:24,212Z tap - INFO Skipping stream: sequence_templates 2022-02-14 11:30:24,212Z tap - INFO Skipping stream: stages 2022-02-14 11:30:24,212Z tap - INFO Skipping stream: personas 2022-02-14 11:30:24,212Z tap - INFO Skipping stream: teams 2022-02-14 11:30:24,212Z tap - INFO Skipping stream: mailboxes 2022-02-14 11:30:24,212Z tap - INFO Skipping stream: accounts 2022-02-14 11:30:24,212Z tap - INFO Skipping stream: opportunities 2022-02-14 11:30:24,212Z tap - INFO call_dispositions - Syncing data since 2021-12-14T19:12:40.000Z - page: 1, limit: 250, offset: 0 2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.call_dispositions = "2021-12-14T19:12:40.000Z" 2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.calls = "2022-02-12T18:51:31.000Z" 2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.events = "2021-03-14T21:21:37.000Z" 2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.mailings = "2021-01-13T00:00:00Z" 2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.prospects = "2022-02-13T11:30:34.000Z" 2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.sequence_states = "2022-02-13T11:30:44.000Z" 2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.sequence_steps = "2022-02-13T09:50:40.000Z" 2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.sequences = "2022-02-13T11:18:29.000Z" 2022-02-14 11:30:24,213Z main - INFO State update: adding bookmarks.tasks = "2022-02-13T11:15:58.000Z" 2022-02-14 11:30:24,213Z main - INFO State update: adding currently_syncing = "call_dispositions" 2022-02-14 11:30:24,492Z tap - INFO HTTP request to "call_dispositions" endpoint took 0.279s, returned status code 503 2022-02-14 11:30:24,492Z tap - INFO Backing off request(...) for 0.6s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset) 2022-02-14 11:30:25,362Z tap - INFO HTTP request to "call_dispositions" endpoint took 0.286s, returned status code 503 2022-02-14 11:30:25,362Z tap - INFO Backing off request(...) for 3.6s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset) 2022-02-14 11:30:29,035Z tap - INFO HTTP request to "call_dispositions" endpoint took 0.097s, returned status code 200 2022-02-14 11:30:29,049Z target - INFO Serializing batch with 37 messages for table call_dispositions 2022-02-14 11:30:29,050Z target - INFO Sending batch of 10440 bytes to https://api.stitchdata.com/v2/import/batch 2022-02-14 11:30:29,142Z main - INFO State update: changing currently_syncing from "call_dispositions" to "calls" 2022-02-14 11:30:29,214Z main - INFO State update: changing bookmarks.calls from "2022-02-12T18:51:31.000Z" to "2022-02-13T20:05:26.000Z" 2022-02-14 11:30:29,214Z main - INFO State update: changing currently_syncing from "calls" to "mailings" 2022-02-14 11:30:29,285Z main - INFO State update: changing currently_syncing from "mailings" to "prospects" 2022-02-14 11:30:29,734Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [3] at offset None 2022-02-14 11:30:29,734Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [0] at offset None 2022-02-14 11:30:29,734Z tap - INFO replicated 37 records from "call_dispositions" endpoint 2022-02-14 11:30:29,734Z tap - INFO calls - Syncing data since 2022-02-12T18:51:31.000Z - page: 1, limit: 250, offset: 0 2022-02-14 11:30:29,734Z tap - INFO HTTP request to "calls" endpoint took 0.109s, returned status code 200 2022-02-14 11:30:30,207Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [1] at offset None 2022-02-14 11:30:30,208Z tap - INFO replicated 5 records from "calls" endpoint 2022-02-14 11:30:30,208Z tap - INFO mailings - Syncing data since 2021-01-13T00:00:00Z - page: 1, limit: 250, offset: 0 2022-02-14 11:30:30,208Z tap - INFO HTTP request to "mailings" endpoint took 0.076s, returned status code 200 2022-02-14 11:30:30,214Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [3] at offset None 2022-02-14 11:30:30,214Z target - INFO replicated 37 records from "call_dispositions" endpoint 2022-02-14 11:30:30,214Z target - INFO Serializing batch with 5 messages for table calls 2022-02-14 11:30:30,214Z target - INFO Sending batch of 6795 bytes to https://api.stitchdata.com/v2/import/batch 2022-02-14 11:30:30,219Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [4] at offset None 2022-02-14 11:30:30,219Z target - INFO replicated 5 records from "calls" endpoint 2022-02-14 11:30:30,229Z tap - INFO replicated 0 records from "mailings" endpoint 2022-02-14 11:30:30,229Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 1, limit: 250, offset: 0 2022-02-14 11:30:30,229Z tap - INFO HTTP request to "prospects" endpoint took 0.295s, returned status code 503 2022-02-14 11:30:30,229Z tap - INFO Backing off request(...) for 1.8s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset) 2022-02-14 11:30:33,142Z tap - INFO HTTP request to "prospects" endpoint took 1.790s, returned status code 200 2022-02-14 11:30:34,039Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [8] at offset None 2022-02-14 11:30:34,040Z tap - INFO replicated 250 records from "prospects" endpoint 2022-02-14 11:30:34,040Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 2, limit: 250, offset: 250 2022-02-14 11:30:34,990Z tap - INFO HTTP request to "prospects" endpoint took 1.438s, returned status code 200 2022-02-14 11:30:35,387Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [3] at offset None 2022-02-14 11:30:35,387Z tap - INFO replicated 250 records from "prospects" endpoint 2022-02-14 11:30:35,387Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 3, limit: 250, offset: 500 2022-02-14 11:30:36,944Z tap - INFO HTTP request to "prospects" endpoint took 1.562s, returned status code 200 2022-02-14 11:30:37,334Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [2] at offset None 2022-02-14 11:30:37,334Z tap - INFO replicated 250 records from "prospects" endpoint 2022-02-14 11:30:37,334Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 4, limit: 250, offset: 750 2022-02-14 11:30:37,601Z tap - INFO HTTP request to "prospects" endpoint took 0.271s, returned status code 503 2022-02-14 11:30:37,601Z tap - INFO Backing off request(...) for 2.8s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset) 2022-02-14 11:30:40,669Z tap - INFO HTTP request to "prospects" endpoint took 0.280s, returned status code 503 2022-02-14 11:30:40,669Z tap - INFO Backing off request(...) for 1.1s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset) 2022-02-14 11:30:42,086Z tap - INFO HTTP request to "prospects" endpoint took 0.287s, returned status code 503 2022-02-14 11:30:42,086Z tap - INFO Backing off request(...) for 5.6s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset) 2022-02-14 11:30:49,344Z tap - INFO HTTP request to "prospects" endpoint took 1.699s, returned status code 200 2022-02-14 11:30:49,704Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [5] at offset None 2022-02-14 11:30:49,704Z tap - INFO replicated 250 records from "prospects" endpoint 2022-02-14 11:30:49,704Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 5, limit: 250, offset: 1000 2022-02-14 11:30:49,975Z tap - INFO HTTP request to "prospects" endpoint took 0.275s, returned status code 503 2022-02-14 11:30:49,975Z tap - INFO Backing off request(...) for 0.5s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset) 2022-02-14 11:30:52,548Z tap - INFO HTTP request to "prospects" endpoint took 2.064s, returned status code 200 2022-02-14 11:30:52,725Z target - INFO Serializing batch with 1109 messages for table prospects 2022-02-14 11:30:52,855Z target - INFO Sending batch of 2017981 bytes to https://api.stitchdata.com/v2/import/batch 2022-02-14 11:30:52,855Z target - INFO Sending batch of 2021392 bytes to https://api.stitchdata.com/v2/import/batch 2022-02-14 11:30:52,865Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [5] at offset None 2022-02-14 11:30:52,866Z target - INFO replicated 1109 records from "prospects" endpoint 2022-02-14 11:30:53,061Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [7] at offset None 2022-02-14 11:30:53,061Z tap - INFO replicated 250 records from "prospects" endpoint 2022-02-14 11:30:53,061Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 6, limit: 250, offset: 1250 2022-02-14 11:30:53,994Z main - INFO State update: changing bookmarks.prospects from "2022-02-13T11:30:34.000Z" to "2022-02-14T05:22:37.000Z" 2022-02-14 11:30:54,925Z tap - INFO HTTP request to "prospects" endpoint took 1.869s, returned status code 200 2022-02-14 11:30:55,309Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [0] at offset None 2022-02-14 11:30:55,309Z tap - INFO replicated 250 records from "prospects" endpoint 2022-02-14 11:30:55,309Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 7, limit: 250, offset: 1500 2022-02-14 11:30:57,246Z tap - INFO HTTP request to "prospects" endpoint took 1.941s, returned status code 200 2022-02-14 11:30:57,641Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [5] at offset None 2022-02-14 11:30:57,641Z tap - INFO replicated 250 records from "prospects" endpoint 2022-02-14 11:30:57,641Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 8, limit: 250, offset: 1750 2022-02-14 11:30:59,490Z tap - INFO HTTP request to "prospects" endpoint took 1.854s, returned status code 200 2022-02-14 11:30:59,865Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [3] at offset None 2022-02-14 11:30:59,865Z tap - INFO replicated 250 records from "prospects" endpoint 2022-02-14 11:30:59,865Z tap - INFO prospects - Syncing data since 2022-02-13T11:30:34.000Z - page: 9, limit: 250, offset: 2000 2022-02-14 11:31:00,258Z tap - INFO HTTP request to "prospects" endpoint took 0.398s, returned status code 200 2022-02-14 11:31:00,344Z target - INFO Serializing batch with 931 messages for table prospects 2022-02-14 11:31:00,348Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [1] at offset None 2022-02-14 11:31:00,348Z tap - INFO replicated 40 records from "prospects" endpoint 2022-02-14 11:31:00,349Z tap - INFO sequence_states - Syncing data since 2022-02-13T11:30:44.000Z - page: 1, limit: 250, offset: 0 2022-02-14 11:31:00,398Z target - INFO Sending batch of 3388974 bytes to https://api.stitchdata.com/v2/import/batch 2022-02-14 11:31:00,406Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [0] at offset None 2022-02-14 11:31:00,406Z target - INFO replicated 931 records from "prospects" endpoint 2022-02-14 11:31:00,753Z tap - INFO HTTP request to "sequence_states" endpoint took 0.408s, returned status code 200 2022-02-14 11:31:00,913Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [1] at offset None 2022-02-14 11:31:00,913Z tap - INFO replicated 250 records from "sequence_states" endpoint 2022-02-14 11:31:00,913Z tap - INFO sequence_states - Syncing data since 2022-02-13T11:30:44.000Z - page: 2, limit: 250, offset: 250 2022-02-14 11:31:01,185Z tap - INFO HTTP request to "sequence_states" endpoint took 0.277s, returned status code 503 2022-02-14 11:31:01,185Z tap - INFO Backing off request(...) for 0.3s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset) 2022-02-14 11:31:01,842Z tap - INFO HTTP request to "sequence_states" endpoint took 0.388s, returned status code 200 2022-02-14 11:31:01,990Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [1] at offset None 2022-02-14 11:31:01,990Z tap - INFO replicated 250 records from "sequence_states" endpoint 2022-02-14 11:31:01,990Z tap - INFO sequence_states - Syncing data since 2022-02-13T11:30:44.000Z - page: 3, limit: 250, offset: 500 2022-02-14 11:31:02,086Z tap - INFO HTTP request to "sequence_states" endpoint took 0.100s, returned status code 200 2022-02-14 11:31:02,094Z target - INFO Serializing batch with 510 messages for table sequence_states 2022-02-14 11:31:02,099Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [2] at offset None 2022-02-14 11:31:02,099Z tap - INFO replicated 10 records from "sequence_states" endpoint 2022-02-14 11:31:02,099Z tap - INFO sequence_steps - Syncing data since 2022-02-13T09:50:40.000Z - page: 1, limit: 250, offset: 0 2022-02-14 11:31:02,100Z target - INFO Sending batch of 310578 bytes to https://api.stitchdata.com/v2/import/batch 2022-02-14 11:31:02,107Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [1] at offset None 2022-02-14 11:31:02,108Z target - INFO replicated 510 records from "sequence_states" endpoint 2022-02-14 11:31:02,214Z tap - INFO HTTP request to "sequence_steps" endpoint took 0.119s, returned status code 200 2022-02-14 11:31:02,231Z target - INFO Serializing batch with 21 messages for table sequence_steps 2022-02-14 11:31:02,231Z target - INFO Sending batch of 15348 bytes to https://api.stitchdata.com/v2/import/batch 2022-02-14 11:31:02,235Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [9] at offset None 2022-02-14 11:31:02,239Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [0] at offset None 2022-02-14 11:31:02,239Z target - INFO replicated 21 records from "sequence_steps" endpoint 2022-02-14 11:31:02,245Z tap - INFO replicated 21 records from "sequence_steps" endpoint 2022-02-14 11:31:02,246Z tap - INFO sequences - Syncing data since 2022-02-13T11:18:29.000Z - page: 1, limit: 250, offset: 0 2022-02-14 11:31:02,347Z main - INFO State update: changing bookmarks.prospects from "2022-02-14T05:22:37.000Z" to "2022-02-14T11:30:57.000Z" 2022-02-14 11:31:02,347Z main - INFO State update: changing currently_syncing from "prospects" to "sequence_states" 2022-02-14 11:31:02,432Z tap - INFO HTTP request to "sequences" endpoint took 0.200s, returned status code 200 2022-02-14 11:31:02,444Z target - INFO Serializing batch with 15 messages for table sequences 2022-02-14 11:31:02,444Z target - INFO Sending batch of 22639 bytes to https://api.stitchdata.com/v2/import/batch 2022-02-14 11:31:02,449Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [7] at offset None 2022-02-14 11:31:02,452Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [1] at offset None 2022-02-14 11:31:02,452Z target - INFO replicated 15 records from "sequences" endpoint 2022-02-14 11:31:02,459Z tap - INFO replicated 15 records from "sequences" endpoint 2022-02-14 11:31:02,459Z tap - INFO tasks - Syncing data since 2022-02-13T11:15:58.000Z - page: 1, limit: 250, offset: 0 2022-02-14 11:31:02,470Z main - INFO State update: changing bookmarks.sequence_states from "2022-02-13T11:30:44.000Z" to "2022-02-14T11:30:57.000Z" 2022-02-14 11:31:02,470Z main - INFO State update: changing currently_syncing from "sequence_states" to "sequence_steps" 2022-02-14 11:31:02,712Z main - INFO State update: changing bookmarks.sequence_steps from "2022-02-13T09:50:40.000Z" to "2022-02-14T11:27:28.000Z" 2022-02-14 11:31:02,712Z main - INFO State update: changing currently_syncing from "sequence_steps" to "sequences" 2022-02-14 11:31:02,725Z tap - INFO HTTP request to "tasks" endpoint took 0.280s, returned status code 503 2022-02-14 11:31:02,725Z tap - INFO Backing off request(...) for 0.7s (tap_outreach.client.Server5xxError: upstream connect error or disconnect/reset before headers. reset reason: local reset) 2022-02-14 11:31:02,863Z main - INFO State update: changing bookmarks.sequences from "2022-02-13T11:18:29.000Z" to "2022-02-14T11:27:28.000Z" 2022-02-14 11:31:02,863Z main - INFO State update: changing currently_syncing from "sequences" to "tasks" 2022-02-14 11:31:03,900Z tap - INFO HTTP request to "tasks" endpoint took 0.463s, returned status code 200 2022-02-14 11:31:03,940Z tap - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [0] at offset None 2022-02-14 11:31:03,940Z tap - INFO replicated 57 records from "tasks" endpoint 2022-02-14 11:31:03,959Z target - INFO Serializing batch with 57 messages for table tasks 2022-02-14 11:31:03,960Z target - INFO Sending batch of 51947 bytes to https://api.stitchdata.com/v2/import/batch 2022-02-14 11:31:03,967Z target - INFO [smart-services] event successfully sent to kafka: com.stitchdata.streamRecordCount [2] at offset None 2022-02-14 11:31:03,967Z target - INFO replicated 57 records from "tasks" endpoint 2022-02-14 11:31:04,062Z main - INFO State update: changing bookmarks.tasks from "2022-02-13T11:15:58.000Z" to "2022-02-14T11:16:00.000Z" 2022-02-14 11:31:04,063Z target - INFO Requests complete, stopping loop 2022-02-14 11:31:04,063Z main - INFO State update: changing currently_syncing from "tasks" to null 2022-02-14 11:31:04,132Z main - INFO Target exited normally with status 0 2022-02-14 11:31:05,186Z main - INFO [smart-services] event successfully sent to kafka: com.stitchdata.extractionJobFinished [16] at offset None 2022-02-14 11:31:05,189Z main - INFO No tunnel subprocess to tear down 2022-02-14 11:31:05,189Z main - INFO Exit status is: Discovery succeeded. Tap succeeded. Target succeeded.

sgandhi1311 commented 1 year ago

Hello @eestack, Can you please confirm whether the issue persists?