~ % kubectl get pod NAME READY STATUS RESTARTS AGE airbyte-db-6b8d588f49-75gg8 1/1 Running 0 18h airbyte-minio-6868565f99-86fpr 1/1 Running 0 18h airbyte-pod-sweeper-667dc5645f-gw77z 1/1 Running 0 18h airbyte-scheduler-6758d99c8-rgpjq 1/1 Running 0 18h airbyte-server-6c7f7b5bbf-hf7jn 1/1 Running 0 18h airbyte-temporal-555f69cdc9-l54lj 1/1 Running 0 18h airbyte-webapp-69bb6d6b9-nzd59 1/1 Running 0 18h airbyte-worker-39-0-unofi 5/5 Running 0 6h51m ~ % kubectl describe pod airbyte-worker-39-0-unofi Name: airbyte-worker-39-0-unofi Namespace: airbyte Priority: 0 Node: ip-172-31-27-249.us-west-2.compute.internal/172.31.27.249 Start Time: Thu, 15 Jul 2021 02:47:38 +0200 Labels: airbyte=worker-pod Annotations: kubernetes.io/psp: eks.privileged Status: Running IP: 172.31.28.138 IPs: IP: 172.31.28.138 Init Containers: init: Container ID: docker://10c77475af0b78fbf025240e5fb120b70b0d35b05fb22cfa54255a9ed67490c2 Image: busybox:1.28 Image ID: docker-pullable://busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47 Port: Host Port: Command: sh -c mkfifo /pipes/stdin && mkfifo /pipes/stdout && mkfifo /pipes/stderr && until [ -f FINISHED_UPLOADING ]; do sleep 5; done; State: Terminated Reason: Completed Exit Code: 0 Started: Thu, 15 Jul 2021 02:47:40 +0200 Finished: Thu, 15 Jul 2021 02:47:45 +0200 Ready: True Restart Count: 0 Environment: Mounts: /config from airbyte-config (rw) /pipes from airbyte-pipes (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-jnnkn (ro) Containers: main: Container ID: docker://01b66f9f708ae3a3564bb132259be0cb3cfec83a322dae2b226612f7d455003e Image: airbyte/destination-s3:0.1.9 Image ID: docker-pullable://airbyte/destination-s3@sha256:8cc57b85782fa07873d72d55e62a3e891401a61fe88cadcc43ce70d2dc136bc3 Port: Host Port: Command: sh -c trap "touch /termination/main" EXIT (cat /pipes/stdin | (/airbyte/base.sh write --config destination_config.json --catalog destination_catalog.json) 2> /pipes/stderr > /pipes/stdout) & CHILD_PID=$! (while true; do if [ -f /termination/check ]; then echo "Heartbeat to worker failed, exiting..."; exit 1; fi; sleep 1; done) & wait $CHILD_PID exit $? State: Running Started: Thu, 15 Jul 2021 02:47:46 +0200 Ready: True Restart Count: 0 Limits: cpu: 1 memory: 512Mi Requests: cpu: 500m memory: 256Mi Environment: Mounts: /config from airbyte-config (rw) /pipes from airbyte-pipes (rw) /termination from airbyte-termination (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-jnnkn (ro) remote-stdin: Container ID: docker://acc29faedb4e66a33c34790f24bc1a7f5bc6ac350d6cab9bd6cb65f60bb46759 Image: alpine/socat:1.7.4.1-r1 Image ID: docker-pullable://alpine/socat@sha256:24486e9da762c6059943a66348b0dece50af1efb1900ca2b43474fecafa73fd4 Port: Host Port: Command: sh -c socat -d -d -d TCP-L:9001 STDOUT > /pipes/stdin State: Running Started: Thu, 15 Jul 2021 02:47:46 +0200 Ready: True Restart Count: 0 Environment: Mounts: /pipes from airbyte-pipes (rw) /termination from airbyte-termination (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-jnnkn (ro) relay-stdout: Container ID: docker://ddd34c6ea05815da3dae338601ff37a6fe70a74400e079c833cf99d9112f66bc Image: alpine/socat:1.7.4.1-r1 Image ID: docker-pullable://alpine/socat@sha256:24486e9da762c6059943a66348b0dece50af1efb1900ca2b43474fecafa73fd4 Port: Host Port: Command: sh -c cat /pipes/stdout | socat -d -d -d - TCP:172.31.24.98:9028 State: Running Started: Thu, 15 Jul 2021 02:47:47 +0200 Ready: True Restart Count: 0 Environment: Mounts: /pipes from airbyte-pipes (rw) /termination from airbyte-termination (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-jnnkn (ro) relay-stderr: Container ID: docker://a0e44b6ffedeb92ff041e51922f9722f14f3dc0dcf0e32b92a4dfa60d8d53359 Image: alpine/socat:1.7.4.1-r1 Image ID: docker-pullable://alpine/socat@sha256:24486e9da762c6059943a66348b0dece50af1efb1900ca2b43474fecafa73fd4 Port: Host Port: Command: sh -c cat /pipes/stderr | socat -d -d -d - TCP:172.31.24.98:9029 State: Running Started: Thu, 15 Jul 2021 02:47:47 +0200 Ready: True Restart Count: 0 Environment: Mounts: /pipes from airbyte-pipes (rw) /termination from airbyte-termination (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-jnnkn (ro) call-heartbeat-server: Container ID: docker://a945bef924bba960c60074496e9d49a41374b8bbbe0ee9a8b3491e7ec9ef153d Image: curlimages/curl:7.77.0 Image ID: docker-pullable://curlimages/curl@sha256:6e0a786e3e5181df00eaf3a0a1749c18a6bb20b01c9bd192ea72176ce8a1c94b Port: Host Port: Command: sh Args: -c trap "touch /termination/check" EXIT (set -e; while true; do curl -s 172.31.24.98:9000 &> /dev/null; sleep 1; done) & CHILD_PID=$! (while true; do if [ -f /termination/main ]; then kill $CHILD_PID; exit 0; fi; sleep 1; done) & wait $CHILD_PID EXIT_CODE=$? if [ -f /termination/main ] then exit 0 else exit $EXIT_CODE fi State: Running Started: Thu, 15 Jul 2021 02:47:47 +0200 Ready: True Restart Count: 0 Environment: Mounts: /termination from airbyte-termination (rw) /var/run/secrets/kubernetes.io/serviceaccount from default-token-jnnkn (ro) Conditions: Type Status Initialized True Ready True ContainersReady True PodScheduled True Volumes: airbyte-pipes: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: airbyte-config: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: airbyte-termination: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: SizeLimit: default-token-jnnkn: Type: Secret (a volume populated by a Secret) SecretName: default-token-jnnkn Optional: false QoS Class: Burstable Node-Selectors: Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s node.kubernetes.io/unreachable:NoExecute op=Exists for 300s Events: ~ % kubectl logs airbyte-worker-39-0-unofi main ~ % kubectl logs airbyte-worker-39-0-unofi remote-stdin 2021/07/15 00:47:46 socat[1] I socat by Gerhard Rieger and contributors - see www.dest-unreach.org 2021/07/15 00:47:46 socat[1] I This product includes software developed by the OpenSSL Project for use in the OpenSSL Toolkit. (http://www.openssl.org/) 2021/07/15 00:47:46 socat[1] I This product includes software written by Tim Hudson (tjh@cryptsoft.com) 2021/07/15 00:47:46 socat[1] I socket(2, 1, 6) -> 5 2021/07/15 00:47:46 socat[1] W ioctl(5, IOCTL_VM_SOCKETS_GET_LOCAL_CID, ...): Not a tty 2021/07/15 00:47:46 socat[1] I starting accept loop 2021/07/15 00:47:46 socat[1] N listening on AF=2 0.0.0.0:9001 2021/07/15 00:47:48 socat[1] I accept(5, {2, AF=2 172.31.24.98:58722}, 16) -> 6 2021/07/15 00:47:48 socat[1] N accepting connection from AF=2 172.31.24.98:58722 on AF=2 172.31.28.138:9001 2021/07/15 00:47:48 socat[1] I permitting connection from AF=2 172.31.24.98:58722 2021/07/15 00:47:48 socat[1] I close(5) 2021/07/15 00:47:48 socat[1] N using stdout for reading and writing 2021/07/15 00:47:48 socat[1] I resolved and opened all sock addresses 2021/07/15 00:47:48 socat[1] N starting data transfer loop with FDs [6,6] and [1,1] ~ % kubectl logs airbyte-worker-39-0-unofi relay-stdout 2021/07/15 00:47:47 socat[7] I socat by Gerhard Rieger and contributors - see www.dest-unreach.org 2021/07/15 00:47:47 socat[7] I This product includes software developed by the OpenSSL Project for use in the OpenSSL Toolkit. (http://www.openssl.org/) 2021/07/15 00:47:47 socat[7] I This product includes software written by Tim Hudson (tjh@cryptsoft.com) 2021/07/15 00:47:47 socat[7] N reading from and writing to stdio 2021/07/15 00:47:47 socat[7] N opening connection to AF=2 172.31.24.98:9028 2021/07/15 00:47:47 socat[7] I starting connect loop 2021/07/15 00:47:47 socat[7] I socket(2, 1, 6) -> 5 2021/07/15 00:47:47 socat[7] N successfully connected from local address AF=2 172.31.28.138:51190 2021/07/15 00:47:47 socat[7] I resolved and opened all sock addresses 2021/07/15 00:47:47 socat[7] N starting data transfer loop with FDs [0,1] and [5,5] 2021/07/15 00:47:48 socat[7] I transferred 148 bytes from 0 to 5 2021/07/15 00:47:48 socat[7] I transferred 184 bytes from 0 to 5 2021/07/15 00:47:48 socat[7] I transferred 89 bytes from 0 to 5 2021/07/15 00:47:49 socat[7] I transferred 223 bytes from 0 to 5 2021/07/15 00:47:49 socat[7] I transferred 130 bytes from 0 to 5 2021/07/15 00:47:50 socat[7] I transferred 228 bytes from 0 to 5 2021/07/15 00:47:50 socat[7] I transferred 369 bytes from 0 to 5 2021/07/15 00:47:50 socat[7] I transferred 218 bytes from 0 to 5 2021/07/15 00:47:50 socat[7] I transferred 364 bytes from 0 to 5 2021/07/15 00:47:50 socat[7] I transferred 206 bytes from 0 to 5 2021/07/15 00:47:51 socat[7] I transferred 358 bytes from 0 to 5 ~ % kubectl logs airbyte-worker-39-0-unofi relay-stderr 2021/07/15 00:47:47 socat[7] I socat by Gerhard Rieger and contributors - see www.dest-unreach.org 2021/07/15 00:47:47 socat[7] I This product includes software developed by the OpenSSL Project for use in the OpenSSL Toolkit. (http://www.openssl.org/) 2021/07/15 00:47:47 socat[7] I This product includes software written by Tim Hudson (tjh@cryptsoft.com) 2021/07/15 00:47:47 socat[7] N reading from and writing to stdio 2021/07/15 00:47:47 socat[7] N opening connection to AF=2 172.31.24.98:9029 2021/07/15 00:47:47 socat[7] I starting connect loop 2021/07/15 00:47:47 socat[7] I socket(2, 1, 6) -> 5 2021/07/15 00:47:47 socat[7] N successfully connected from local address AF=2 172.31.28.138:42588 2021/07/15 00:47:47 socat[7] I resolved and opened all sock addresses 2021/07/15 00:47:47 socat[7] N starting data transfer loop with FDs [0,1] and [5,5]