Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

HubSpot Sync Job Hangs on engagements Sync #11252

Closed
ghost opened this issue Mar 18, 2022 · 8 comments
Closed

HubSpot Sync Job Hangs on engagements Sync #11252

ghost opened this issue Mar 18, 2022 · 8 comments
Labels
community type/bug Something isn't working

Comments

@ghost
Copy link

ghost commented Mar 18, 2022

Environment

  • Airbyte version: 0.35.55-alpha
  • OS Version / Instance: Debian Buster, GCP e2-standard-2
  • Deployment: Docker
  • Source Connector and version: HubSpot 0.1.48 -->
  • Destination Connector and version: BigQuery 0.6.11 -->
  • Severity: Medium
  • Step where error happened: Sync job

Current Behavior

Airbyte sync hangs on Syncing stream: engagements, syncs succeed without engagements

Expected Behavior

Airbyte should sync engagements from HubSpot

Logs

If applicable, please upload the logs from the failing operation.
For sync jobs, you can download the full logs from the UI by going to the sync attempt page and
clicking the download logs button at the top right of the logs display window.

LOG 

2022-03-17 15:46:47 �[32mINFO�[m i.a.w.w.WorkerRun(call):49 - Executing worker wrapper. Airbyte version: 0.35.55-alpha
2022-03-17 15:46:48 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/394/0/logs.log
2022-03-17 15:46:48 �[32mINFO�[m i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.35.55-alpha
2022-03-17 15:46:48 �[32mINFO�[m i.a.w.DefaultReplicationWorker(run):104 - start sync worker. job id: 394 attempt id: 0
2022-03-17 15:46:48 �[32mINFO�[m i.a.w.DefaultReplicationWorker(run):116 - configured sync modes: {null.engagements=full_refresh - append}
2022-03-17 15:46:48 �[32mINFO�[m i.a.w.p.a.DefaultAirbyteDestination(start):69 - Running destination...
2022-03-17 15:46:48 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:0.6.11 exists...
2022-03-17 15:46:48 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:0.6.11 was found locally.
2022-03-17 15:46:48 �[32mINFO�[m i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 394
2022-03-17 15:46:48 �[32mINFO�[m i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/394/0 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:0.6.11 -e WORKER_JOB_ATTEMPT=0 -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.35.55-alpha -e WORKER_JOB_ID=394 airbyte/destination-bigquery:0.6.11 write --config destination_config.json --catalog destination_catalog.json
2022-03-17 15:46:48 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-hubspot:0.1.48 exists...
2022-03-17 15:46:48 �[32mINFO�[m i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-hubspot:0.1.48 was found locally.
2022-03-17 15:46:48 �[32mINFO�[m i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 394
2022-03-17 15:46:48 �[32mINFO�[m i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/394/0 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_CONNECTOR_IMAGE=airbyte/source-hubspot:0.1.48 -e WORKER_JOB_ATTEMPT=0 -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.35.55-alpha -e WORKER_JOB_ID=394 airbyte/source-hubspot:0.1.48 read --config source_config.json --catalog source_catalog.json --state input_state.json
2022-03-17 15:46:48 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$6):339 - Destination output thread started.
2022-03-17 15:46:48 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):279 - Replication thread started.
2022-03-17 15:46:48 �[32mINFO�[m i.a.w.DefaultReplicationWorker(run):158 - Waiting for source and destination threads to complete.
2022-03-17 15:46:49 �[43mdestination�[0m > SLF4J: Class path contains multiple SLF4J bindings.
2022-03-17 15:46:49 �[43mdestination�[0m > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-03-17 15:46:49 �[43mdestination�[0m > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-03-17 15:46:49 �[43mdestination�[0m > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-03-17 15:46:49 �[43mdestination�[0m > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-03-17 15:46:50 �[44msource�[0m > Starting syncing SourceHubspot
2022-03-17 15:46:50 �[44msource�[0m > Syncing stream: engagements 
2022-03-17 15:46:51 �[43mdestination�[0m > 2022-03-17 15:46:51 �[32mINFO�[m i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2022-03-17 15:46:51 �[43mdestination�[0m > 2022-03-17 15:46:51 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):103 - Sentry transaction event: b34f6aa35ad44d8cb67e420f77e06080
2022-03-17 15:46:51 �[43mdestination�[0m > 2022-03-17 15:46:51 �[32mINFO�[m i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2022-03-17 15:46:51 �[43mdestination�[0m > 2022-03-17 15:46:51 �[32mINFO�[m i.a.i.b.IntegrationRunner(runInternal):122 - Command: WRITE
2022-03-17 15:46:51 �[43mdestination�[0m > 2022-03-17 15:46:51 �[32mINFO�[m i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2022-03-17 15:46:51 �[43mdestination�[0m > 2022-03-17 15:46:51 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-03-17 15:46:51 �[43mdestination�[0m > 2022-03-17 15:46:51 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-03-17 15:46:52 �[43mdestination�[0m > 2022-03-17 15:46:52 �[32mINFO�[m i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD
2022-03-17 15:46:54 �[43mdestination�[0m > 2022-03-17 15:46:54 �[32mINFO�[m i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=hubspot, tableId=_airbyte_tmp_qzq_engagements}} created successfully
2022-03-17 15:47:01 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 1000 (8 MB)
2022-03-17 15:47:09 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 2000 (17 MB)
2022-03-17 15:47:18 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 3000 (25 MB)
2022-03-17 15:47:28 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 4000 (34 MB)
2022-03-17 15:47:35 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 5000 (43 MB)
2022-03-17 15:47:42 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 6000 (51 MB)
2022-03-17 15:47:49 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 7000 (60 MB)
2022-03-17 15:47:58 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 8000 (68 MB)
2022-03-17 15:48:06 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 9000 (77 MB)
2022-03-17 15:48:14 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 10000 (86 MB)
2022-03-17 15:48:22 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 11000 (94 MB)
2022-03-17 15:48:29 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 12000 (103 MB)
2022-03-17 15:48:36 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 13000 (111 MB)
2022-03-17 15:48:44 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 14000 (120 MB)
2022-03-17 15:48:52 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 15000 (129 MB)
2022-03-17 15:48:59 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 16000 (137 MB)
2022-03-17 15:49:08 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 17000 (146 MB)
2022-03-17 15:49:15 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 18000 (154 MB)
2022-03-17 15:49:22 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 19000 (163 MB)
2022-03-17 15:49:31 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 20000 (172 MB)
2022-03-17 15:49:37 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 21000 (180 MB)
2022-03-17 15:49:45 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 22000 (189 MB)
2022-03-17 15:49:52 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 23000 (197 MB)
2022-03-17 15:49:58 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 24000 (206 MB)
2022-03-17 15:50:06 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 25000 (215 MB)
2022-03-17 15:50:12 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 26000 (223 MB)
2022-03-17 15:50:19 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 27000 (232 MB)
2022-03-17 15:50:27 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 28000 (240 MB)
2022-03-17 15:50:35 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 29000 (249 MB)
2022-03-17 15:50:43 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 30000 (258 MB)
2022-03-17 15:50:52 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 31000 (266 MB)
2022-03-17 15:51:00 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 32000 (275 MB)
2022-03-17 15:51:09 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 33000 (283 MB)
2022-03-17 15:51:16 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 34000 (292 MB)
2022-03-17 15:51:25 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 35000 (301 MB)
2022-03-17 15:51:34 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 36000 (309 MB)
2022-03-17 15:51:41 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 37000 (318 MB)
2022-03-17 15:51:49 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 38000 (327 MB)
2022-03-17 15:51:57 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 39000 (335 MB)
2022-03-17 15:52:05 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 40000 (344 MB)
2022-03-17 15:52:14 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 41000 (352 MB)
2022-03-17 15:52:22 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 42000 (361 MB)
2022-03-17 15:52:30 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 43000 (370 MB)
2022-03-17 15:52:37 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 44000 (378 MB)
2022-03-17 15:52:45 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 45000 (387 MB)
2022-03-17 15:52:53 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 46000 (395 MB)
2022-03-17 15:53:00 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 47000 (404 MB)
2022-03-17 15:53:08 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 48000 (413 MB)
2022-03-17 15:53:16 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 49000 (421 MB)
2022-03-17 15:53:24 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 50000 (430 MB)
2022-03-17 15:53:32 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 51000 (438 MB)
2022-03-17 15:53:39 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 52000 (447 MB)
2022-03-17 15:53:46 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 53000 (456 MB)
2022-03-17 15:53:53 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 54000 (464 MB)
2022-03-17 15:53:59 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 55000 (473 MB)
2022-03-17 15:54:08 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 56000 (481 MB)
2022-03-17 15:54:16 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 57000 (490 MB)
2022-03-17 15:54:25 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 58000 (499 MB)
2022-03-17 15:54:33 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 59000 (507 MB)
2022-03-17 15:54:40 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 60000 (516 MB)
2022-03-17 15:54:48 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 61000 (524 MB)
2022-03-17 15:54:55 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 62000 (533 MB)
2022-03-17 15:55:02 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 63000 (542 MB)
2022-03-17 15:55:09 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 64000 (550 MB)
2022-03-17 15:55:17 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 65000 (559 MB)
2022-03-17 15:55:26 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 66000 (567 MB)
2022-03-17 15:55:33 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 67000 (576 MB)
2022-03-17 15:55:41 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 68000 (585 MB)
2022-03-17 15:55:49 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 69000 (593 MB)
2022-03-17 15:55:55 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 70000 (602 MB)
2022-03-17 15:56:03 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 71000 (610 MB)
2022-03-17 15:56:13 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 72000 (619 MB)
2022-03-17 15:56:20 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 73000 (628 MB)
2022-03-17 15:56:28 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 74000 (636 MB)
2022-03-17 15:56:37 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 75000 (645 MB)
2022-03-17 15:56:44 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 76000 (654 MB)
2022-03-17 15:56:54 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 77000 (662 MB)
2022-03-17 15:57:00 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 78000 (671 MB)
2022-03-17 15:57:10 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 79000 (679 MB)
2022-03-17 15:57:18 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 80000 (688 MB)
2022-03-17 15:57:26 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 81000 (697 MB)
2022-03-17 15:57:33 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 82000 (705 MB)
2022-03-17 15:57:41 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 83000 (714 MB)
2022-03-17 15:57:48 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 84000 (722 MB)
2022-03-17 15:57:54 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 85000 (731 MB)
2022-03-17 15:58:01 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 86000 (740 MB)
2022-03-17 15:58:08 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 87000 (748 MB)
2022-03-17 15:58:16 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 88000 (757 MB)
2022-03-17 15:58:23 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 89000 (765 MB)
2022-03-17 15:58:29 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 90000 (774 MB)
2022-03-17 15:58:36 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 91000 (783 MB)
2022-03-17 15:58:44 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 92000 (791 MB)
2022-03-17 15:58:52 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 93000 (800 MB)
2022-03-17 15:59:00 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 94000 (808 MB)
2022-03-17 15:59:08 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 95000 (817 MB)
2022-03-17 15:59:16 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 96000 (826 MB)
2022-03-17 15:59:24 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 97000 (834 MB)
2022-03-17 15:59:31 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 98000 (843 MB)
2022-03-17 15:59:39 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 99000 (851 MB)
2022-03-17 15:59:46 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 100000 (860 MB)
2022-03-17 15:59:53 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 101000 (869 MB)
2022-03-17 16:00:01 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 102000 (877 MB)
2022-03-17 16:00:09 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 103000 (886 MB)
2022-03-17 16:00:17 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 104000 (894 MB)
2022-03-17 16:00:23 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 105000 (903 MB)
2022-03-17 16:00:30 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 106000 (912 MB)
2022-03-17 16:00:38 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 107000 (920 MB)
2022-03-17 16:00:46 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 108000 (929 MB)
2022-03-17 16:00:54 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 109000 (938 MB)
2022-03-17 16:01:02 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 110000 (946 MB)
2022-03-17 16:01:10 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 111000 (955 MB)
2022-03-17 16:01:19 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 112000 (963 MB)
2022-03-17 16:01:27 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 113000 (972 MB)
2022-03-17 16:01:35 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 114000 (981 MB)
2022-03-17 16:01:43 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 115000 (989 MB)
2022-03-17 16:01:51 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 116000 (998 MB)
2022-03-17 16:01:58 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 117000 (1006 MB)
2022-03-17 16:02:05 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 118000 (1015 MB)
2022-03-17 16:02:14 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 119000 (1 GB)
2022-03-17 16:02:23 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 120000 (1 GB)
2022-03-17 16:02:32 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 121000 (1 GB)
2022-03-17 16:02:39 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 122000 (1 GB)
2022-03-17 16:02:47 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 123000 (1 GB)
2022-03-17 16:02:56 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 124000 (1 GB)
2022-03-17 16:03:03 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 125000 (1 GB)
2022-03-17 16:03:10 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 126000 (1 GB)
2022-03-17 16:03:17 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 127000 (1 GB)
2022-03-17 16:03:25 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 128000 (1 GB)
2022-03-17 16:03:32 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 129000 (1 GB)
2022-03-17 16:03:41 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 130000 (1 GB)
2022-03-17 16:03:49 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 131000 (1 GB)
2022-03-17 16:03:56 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 132000 (1 GB)
2022-03-17 16:04:06 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 133000 (1 GB)
2022-03-17 16:04:15 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 134000 (1 GB)
2022-03-17 16:04:26 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 135000 (1 GB)
2022-03-17 16:04:33 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 136000 (1 GB)
2022-03-17 16:04:44 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 137000 (1 GB)
2022-03-17 16:04:51 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 138000 (1 GB)
2022-03-17 16:04:57 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 139000 (1 GB)
2022-03-17 16:05:05 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 140000 (1 GB)
2022-03-17 16:05:12 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 141000 (1 GB)
2022-03-17 16:05:21 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 142000 (1 GB)
2022-03-17 16:05:29 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 143000 (1 GB)
2022-03-17 16:05:36 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 144000 (1 GB)
2022-03-17 16:05:47 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 145000 (1 GB)
2022-03-17 16:05:56 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 146000 (1 GB)
2022-03-17 16:06:07 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 147000 (1 GB)
2022-03-17 16:06:18 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 148000 (1 GB)
2022-03-17 16:06:26 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 149000 (1 GB)
2022-03-17 16:06:35 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 150000 (1 GB)
2022-03-17 16:06:46 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 151000 (1 GB)
2022-03-17 16:06:54 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 152000 (1 GB)
2022-03-17 16:07:03 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 153000 (1 GB)
2022-03-17 16:07:14 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 154000 (1 GB)
2022-03-17 16:07:23 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 155000 (1 GB)
2022-03-17 16:07:30 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 156000 (1 GB)
2022-03-17 16:07:38 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 157000 (1 GB)
2022-03-17 16:07:45 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 158000 (1 GB)
2022-03-17 16:07:52 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 159000 (1 GB)
2022-03-17 16:07:59 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 160000 (1 GB)
2022-03-17 16:08:08 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 161000 (1 GB)
2022-03-17 16:08:16 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 162000 (1 GB)
2022-03-17 16:08:24 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 163000 (1 GB)
2022-03-17 16:08:31 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 164000 (1 GB)
2022-03-17 16:08:38 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 165000 (1 GB)
2022-03-17 16:08:46 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 166000 (1 GB)
2022-03-17 16:08:53 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 167000 (1 GB)
2022-03-17 16:09:00 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 168000 (1 GB)
2022-03-17 16:09:08 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 169000 (1 GB)
2022-03-17 16:09:15 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 170000 (1 GB)
2022-03-17 16:09:23 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 171000 (1 GB)
2022-03-17 16:09:31 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 172000 (1 GB)
2022-03-17 16:09:39 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 173000 (1 GB)
2022-03-17 16:09:46 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 174000 (1 GB)
2022-03-17 16:09:53 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 175000 (1 GB)
2022-03-17 16:09:59 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 176000 (1 GB)
2022-03-17 16:10:08 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 177000 (1 GB)
2022-03-17 16:10:15 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 178000 (1 GB)
2022-03-17 16:10:23 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 179000 (1 GB)
2022-03-17 16:10:30 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 180000 (1 GB)
2022-03-17 16:10:37 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 181000 (1 GB)
2022-03-17 16:10:45 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 182000 (1 GB)
2022-03-17 16:10:53 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 183000 (1 GB)
2022-03-17 16:11:00 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 184000 (1 GB)
2022-03-17 16:11:09 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 185000 (1 GB)
2022-03-17 16:11:16 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 186000 (1 GB)
2022-03-17 16:11:23 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 187000 (1 GB)
2022-03-17 16:11:30 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 188000 (1 GB)
2022-03-17 16:11:38 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 189000 (1 GB)
2022-03-17 16:11:45 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 190000 (1 GB)
2022-03-17 16:11:52 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 191000 (1 GB)
2022-03-17 16:11:58 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 192000 (1 GB)
2022-03-17 16:12:06 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 193000 (1 GB)
2022-03-17 16:12:12 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 194000 (1 GB)
2022-03-17 16:12:19 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 195000 (1 GB)
2022-03-17 16:12:27 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 196000 (1 GB)
2022-03-17 16:12:35 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 197000 (1 GB)
2022-03-17 16:12:42 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 198000 (1 GB)
2022-03-17 16:12:49 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 199000 (1 GB)
2022-03-17 16:12:57 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 200000 (1 GB)
2022-03-17 16:13:05 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 201000 (1 GB)
2022-03-17 16:13:11 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 202000 (1 GB)
2022-03-17 16:13:18 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 203000 (1 GB)
2022-03-17 16:13:26 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 204000 (1 GB)
2022-03-17 16:13:33 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 205000 (1 GB)
2022-03-17 16:13:42 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 206000 (1 GB)
2022-03-17 16:13:50 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 207000 (1 GB)
2022-03-17 16:13:57 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 208000 (1 GB)
2022-03-17 16:14:05 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 209000 (1 GB)
2022-03-17 16:14:13 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 210000 (1 GB)
2022-03-17 16:14:21 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 211000 (1 GB)
2022-03-17 16:14:27 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 212000 (1 GB)
2022-03-17 16:14:33 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 213000 (1 GB)
2022-03-17 16:14:39 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 214000 (1 GB)
2022-03-17 16:14:44 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 215000 (1 GB)
2022-03-17 16:14:49 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 216000 (1 GB)
2022-03-17 16:14:55 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 217000 (1 GB)
2022-03-17 16:15:00 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 218000 (1 GB)
2022-03-17 16:15:05 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 219000 (1 GB)
2022-03-17 16:15:10 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 220000 (1 GB)
2022-03-17 16:15:15 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 221000 (1 GB)
2022-03-17 16:15:18 �[44msource�[0m > Backing off _send(...) for 5.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException)
2022-03-17 16:15:24 �[44msource�[0m > Caught retryable error '' after 1 tries. Waiting 5 seconds then retrying...
2022-03-17 16:15:25 �[44msource�[0m > Backing off _send(...) for 5.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException)
2022-03-17 16:15:31 �[44msource�[0m > Caught retryable error '' after 1 tries. Waiting 5 seconds then retrying...
2022-03-17 16:15:34 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 222000 (1 GB)
[...]
2022-03-18 08:52:21 �[32mINFO�[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 10184000 (85 GB)

Steps to Reproduce

1.Setup HubSpot source with API key and engagements as an input
2.Setup BigQuery destination
3.Run a sync job

Are you willing to submit a PR?

Yes
@ghost ghost added needs-triage type/bug Something isn't working labels Mar 18, 2022
@ghost
Copy link
Author

ghost commented Mar 18, 2022

Similar to #10544

@FilipeAraujo
Copy link

I'm having a different issue, but also around engagements.

I have 320k engagements in hubspot but while importing it can reach like 32M rows (with duplicates) of data, is that normal? I tried to divide the import into two connections, one with only engagements and the other with all except engagements, the result is the same AND the result of the tables without engagements I've got:

2022-03-18 17:52:48 source > Syncing stream: marketing_emails 
2022-03-18 17:52:51 source > Read 250 records from marketing_emails stream
2022-03-18 17:52:51 source > Finished syncing SourceHubspot
2022-03-18 17:52:51 source > SourceHubspot runtimes:
2022-03-18 17:52:51 source > Syncing stream: owners 
2022-03-18 17:52:51 source > Read 37 records from owners stream
2022-03-18 17:52:51 source > Finished syncing SourceHubspot
2022-03-18 17:52:51 source > SourceHubspot runtimes:
2022-03-18 17:52:51 source > Syncing stream: products 
2022-03-18 17:52:51 source > Advancing bookmark for products stream from None to 2022-02-22T10:57:58.575000+00:00
2022-03-18 17:52:51 source > Read 1 records from products stream
2022-03-18 17:52:51 source > Finished syncing SourceHubspot
2022-03-18 17:52:51 source > SourceHubspot runtimes:
2022-03-18 17:52:51 source > Syncing stream: property_history 
2022-03-18 18:31:42 source > Backing off _send(...) for 5.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException)

And it's stuck there forever. If you need more details I can add them.

Thanks.

@ghost
Copy link
Author

ghost commented Mar 21, 2022

@FilipeAraujo I think it's the same issue, I am pulling million of rows even if I only have 600k engagements.

@FilipeAraujo
Copy link

@matfiorlh I think this is related #11266, hope someone approves it and releases it.

@ghost
Copy link
Author

ghost commented Mar 21, 2022

That's likely, thanks for pointing it out.

@FilipeAraujo
Copy link

FilipeAraujo commented Mar 23, 2022 •
edited
Loading

@matfiorlh I think the fix has been released (0.1.50), I'm testing, can you please test? and maybe close this issue?

@ghost
Copy link
Author

ghost commented Mar 23, 2022

Of course, will do right now.

@ghost
Copy link
Author

ghost commented Mar 23, 2022

It works, I'll close the issue.

@ghost ghost closed this as completed Mar 23, 2022
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
community type/bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@FilipeAraujo @marcosmarxm @octavia-squidington-iii