Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

pns executor w/ security context not working with vault injector #6030

Closed
rwong2888 opened this issue May 26, 2021 · 38 comments · Fixed by #6084
Closed

pns executor w/ security context not working with vault injector #6030

rwong2888 opened this issue May 26, 2021 · 38 comments · Fixed by #6084
Assignees
@alexec
Labels
type/bug
Milestone
v3.1

Comments

@rwong2888
Copy link
Contributor

rwong2888 commented May 26, 2021 •
edited
Loading

I'm using vault injector with pns executor. It works fine until I add security context to not run as root. Vault sidecar container not getting killed. Details below.

apiVersion: v1
data:
  containerRuntimeExecutor: pns
  workflowDefaults: |
    spec:
      securityContext:
        runAsNonRoot: true
        runAsUser: 8737

---
apiVersion: argoproj.io/v1alpha1
kind: WorkflowTemplate
metadata:
  name: git-clone
spec:
  ...
  templates:
    - name: git-clone
        artifacts:
          - name: argo-source
            path: /src
            git:
              repo: "{{inputs.parameters.repo}}"
              revision: "{{inputs.parameters.revision}}"
              usernameSecret:
                name: github-creds
                key: username
              passwordSecret:
                name: github-creds
                key: password
      metadata:
        annotations:
          vault.hashicorp.com/agent-inject: "true"
          vault.hashicorp.com/role: "xxxx
          vault.hashicorp.com/auth-path: "xxx"
          vault.hashicorp.com/secret-volume-path: "/tmp/vault"
          vault.hashicorp.com/agent-inject-secret-npmrc: "xxx"
          vault.hashicorp.com/agent-inject-template-npmrc: |
            {{- with secret "xxx" -}}
              {{ .Data.data.npmrc }}
            {{- end }}
      container:
        image: alpine/git:latest
        command: [sh, -c]
        args:
          - |-
                cp /tmp/vault/secrets/npmrc ./.npmrc

        volumeMounts:
          - name: tmp
            mountPath: /tmp
        workingDir: /src
      volumes:
        - name: tmp
          emptyDir: {}
      outputs:
        artifacts:
          - name: src
            path: /src
            globalName: src

time="2021-05-26T23:08:58.651Z" level=info msg="Starting Workflow Executor" executorType=pns version=v3.1.0-rc8
time="2021-05-26T23:08:58.655Z" level=info msg="Creating PNS executor (namespace: argo, pod: ci-4fqjw-539851645, pid: 66)"
time="2021-05-26T23:08:58.655Z" level=info msg="Creating a K8sAPI executor"
time="2021-05-26T23:08:58.655Z" level=info msg="Executor (version: v3.1.0-rc8, build_date: 2021-05-25T15:15:42Z) initialized (pod: argo/ci-4fqjw-539851645) with template:\n{\"name\":\"git-clone\",\"inputs\":{\"parameters\":[{\"name\":\"repo\",\"value\":\"https://github.com/Forbes-Media/dp-seal.git\"},{\"name\":\"revision\",\"value\":\"main\"},{\"name\":\"generate-artifactory-credentials\",\"value\":\"false\"}],\"artifacts\":[{\"name\":\"argo-source\",\"path\":\"/src\",\"git\":{\"repo\":\"https://github.com/Forbes-Media/dp-seal.git\",\"revision\":\"main\",\"usernameSecret\":{\"name\":\"github-creds\",\"key\":\"username\"},\"passwordSecret\":{\"name\":\"github-creds\",\"key\":\"password\"}}}]},\"outputs\":{\"artifacts\":[{\"name\":\"src\",\"path\":\"/src\",\"globalName\":\"src\"},{\"name\":\"git-labels\",\"path\":\"/tmp/git-labels\",\"globalName\":\"git-labels\"}]},\"metadata\":{\"annotations\":{\"vault.hashicorp.com/agent-inject\":\"true\",\"vault.hashicorp.com/agent-inject-secret-npmrc\":\"kv/data/operations/argo/jfrog\",\"vault.hashicorp.com/agent-inject-template-npmrc\":\"{{- with secret \\\"kv/data/operations/argo/jfrog\\\" -}}\\n  {{ .Data.data.npmrc }}\\n{{- end }}\\n\",\"vault.hashicorp.com/auth-path\":\"/auth/development-playground\",\"vault.hashicorp.com/role\":\"operations-read-only\",\"vault.hashicorp.com/secret-volume-path\":\"/tmp/vault\"}},\"container\":{\"name\":\"\",\"image\":\"forbes-docker.jfrog.io/alpine/git:latest\",\"command\":[\"sh\",\"-c\"],\"args\":[\"if [[ \\\"false\\\" == \\\"true\\\" ]]; then\\n  cp /tmp/vault/secrets/npmrc ./.npmrc\\nfi\\n# spaces bad for clobber-args\\n# GIT_AUTHOR_NAME=$(git log -1 --pretty=format:'%an')\\nGIT_AUTHOR_EMAIL=$(git log -1 --pretty=format:'%ae')\\n# GIT_COMMIT_MESSAGE=$(git log -1 --pretty=%B | head -1)\\nGIT_COMMIT_HASH=$(git log -1 --format=\\\"%H\\\")\\nOUTPUT=/tmp/git-labels\\necho \\\"GIT_REPO=\\\\\\\"https://github.com/Forbes-Media/dp-seal.git\\\\\\\"\\\" | tee -a ${OUTPUT}\\necho \\\"GIT_REVISION=\\\\\\\"main\\\\\\\"\\\" | tee -a ${OUTPUT}\\n# echo \\\"GIT_AUTHOR_NAME=\\\\\\\"${GIT_AUTHOR_NAME}\\\\\\\"\\\" | tee -a ${OUTPUT}\\necho \\\"GIT_AUTHOR_EMAIL=\\\\\\\"${GIT_AUTHOR_EMAIL}\\\\\\\"\\\" | tee -a ${OUTPUT}\\n# echo \\\"GIT_COMMIT_MESSAGE=\\\\\\\"${GIT_COMMIT_MESSAGE}\\\\\\\"\\\" | tee -a ${OUTPUT}\\necho \\\"GIT_COMMIT_HASH=\\\\\\\"${GIT_COMMIT_HASH}\\\\\\\"\\\" | tee -a ${OUTPUT}\"],\"workingDir\":\"/src\",\"resources\":{},\"volumeMounts\":[{\"name\":\"tmp\",\"mountPath\":\"/tmp\"}]},\"volumes\":[{\"name\":\"tmp\",\"emptyDir\":{}}],\"archiveLocation\":{\"gcs\":{\"bucket\":\"argo-artifact-repository\",\"key\":\"ci-4fqjw/ci-4fqjw-539851645\"}}}"
time="2021-05-26T23:08:58.655Z" level=info msg="Starting annotations monitor"
time="2021-05-26T23:08:58.655Z" level=info msg="Starting deadline monitor"
time="2021-05-26T23:08:59.717Z" level=warning msg="failed to secure root file handle for 82" error="open /proc/82/root: permission denied"
time="2021-05-26T23:08:59.768Z" level=warning msg="failed to secure root file handle for 82" error="open /proc/82/root: permission denied"
time="2021-05-26T23:08:59.921Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/root: permission denied"
time="2021-05-26T23:08:59.971Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/root: permission denied"
time="2021-05-26T23:09:00.022Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.022Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.073Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.073Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.124Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.124Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.174Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.174Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.225Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.225Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.276Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.276Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.326Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.326Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.377Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.377Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.428Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.428Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.478Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.478Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.529Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.529Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.580Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.580Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.631Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.631Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.681Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.681Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.732Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.732Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.782Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.783Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.833Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.833Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.884Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.884Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.935Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.935Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:00.985Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:00.985Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.037Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.037Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.088Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.088Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.138Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.139Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.189Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.189Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.240Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.240Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.291Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.291Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.341Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.341Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.392Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.392Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.443Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.443Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.494Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.494Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.544Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.544Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.595Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.595Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.646Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.646Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.696Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.696Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.747Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.747Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.798Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.798Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.848Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.848Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.899Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.899Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:01.950Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:01.950Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.001Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.001Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.052Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.052Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.102Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.102Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.153Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.153Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.204Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.204Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.254Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.254Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.305Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.305Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.356Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.356Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.406Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.406Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.457Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.457Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.508Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.508Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.559Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.559Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.609Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.609Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.660Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.660Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.711Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.711Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.762Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.762Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.812Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.812Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.863Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.863Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.913Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.914Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:02.964Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:02.964Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.015Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.015Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.065Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.065Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.116Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.116Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.167Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.167Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.217Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.217Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.268Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.268Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.319Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.319Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.369Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.370Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.420Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.420Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.471Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.471Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.521Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.521Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.572Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.572Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.623Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.623Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.664Z" level=info msg="Watch pods 200"
time="2021-05-26T23:09:03.674Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.674Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.676Z" level=info msg="Main container completed"
time="2021-05-26T23:09:03.677Z" level=info msg="No Script output reference in workflow. Capturing script output ignored"
time="2021-05-26T23:09:03.677Z" level=info msg="No output parameters"
time="2021-05-26T23:09:03.677Z" level=info msg="Saving output artifacts"
time="2021-05-26T23:09:03.677Z" level=info msg="Staging artifact: src"
time="2021-05-26T23:09:03.677Z" level=info msg="Staging /src from mirrored volume mount /mainctrfs/src"
time="2021-05-26T23:09:03.677Z" level=info msg="Taring /mainctrfs/src"
time="2021-05-26T23:09:03.725Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.725Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.776Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.776Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.826Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.826Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.877Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.877Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.928Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.928Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:03.979Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:03.979Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.030Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.030Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.080Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.081Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.131Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.131Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.182Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.182Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.233Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.233Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.284Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.284Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.335Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.335Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.385Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.386Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.436Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.436Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.487Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.487Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.538Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.538Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.589Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.589Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.639Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.639Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.642Z" level=info msg="archived 82 files/dirs in /mainctrfs/src"
time="2021-05-26T23:09:04.642Z" level=info msg="Successfully staged /src from mirrored volume mount /mainctrfs/src"
time="2021-05-26T23:09:04.642Z" level=info msg="GCS Save path: /tmp/argo/outputs/artifacts/src.tgz, key: ci-4fqjw/ci-4fqjw-539851645/src.tgz"
time="2021-05-26T23:09:04.690Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.690Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.741Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.741Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.793Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.793Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.843Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.843Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.894Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.894Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.945Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.945Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:04.995Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:04.995Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.046Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.046Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.097Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.097Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.148Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.148Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.198Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.198Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.249Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.249Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.300Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.300Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.351Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.351Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.401Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.401Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.452Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.452Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.503Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.503Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.554Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.554Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.574Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/artifacts/src.tgz
time="2021-05-26T23:09:05.574Z" level=info msg="Successfully saved file: /tmp/argo/outputs/artifacts/src.tgz"
time="2021-05-26T23:09:05.574Z" level=info msg="Staging artifact: git-labels"
time="2021-05-26T23:09:05.574Z" level=info msg="Staging /tmp/git-labels from mirrored volume mount /mainctrfs/tmp/git-labels"
time="2021-05-26T23:09:05.574Z" level=info msg="Taring /mainctrfs/tmp/git-labels"
time="2021-05-26T23:09:05.576Z" level=info msg="Successfully staged /tmp/git-labels from mirrored volume mount /mainctrfs/tmp/git-labels"
time="2021-05-26T23:09:05.576Z" level=info msg="GCS Save path: /tmp/argo/outputs/artifacts/git-labels.tgz, key: ci-4fqjw/ci-4fqjw-539851645/git-labels.tgz"
time="2021-05-26T23:09:05.604Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.604Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.655Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.655Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.706Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.706Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.729Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/artifacts/git-labels.tgz
time="2021-05-26T23:09:05.729Z" level=info msg="Successfully saved file: /tmp/argo/outputs/artifacts/git-labels.tgz"
time="2021-05-26T23:09:05.729Z" level=info msg="Annotating pod with output"
time="2021-05-26T23:09:05.757Z" level=info msg="secured root for pid 97 root: vault (\"/proc/97/root\")"
time="2021-05-26T23:09:05.757Z" level=warning msg="failed to secure root file handle for 97" error="open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.767Z" level=info msg="Patch pods 200"
time="2021-05-26T23:09:05.769Z" level=error msg="executor error: failed to get container name for process 97: open /proc/97/environ: permission denied"
time="2021-05-26T23:09:05.769Z" level=info msg="Alloc=22385 TotalAlloc=60246 Sys=73297 NumGC=8 Goroutines=13"
@alexec alexec self-assigned this May 26, 2021
alexec added a commit to alexec/argo-workflows that referenced this issue May 26, 2021
@alexec
fix(executor): Allow PNS to runAsRaot with injected sidecar. Fixes ar…
edbde68 
…goproj#6030

Signed-off-by: Alex Collins <alex_collins@intuit.com>
@alexec alexec added this to the v3.1 milestone May 26, 2021
This was linked to pull requests May 26, 2021
fix(executor): Allow PNS to runAsRoot with injected sidecar. Fixes #6030 #6031
Closed
fix(executor): Allow PNS to runAsNonRoot with injected sidecar. Fixes #6030 #6032
Closed
@alexec
Copy link
Contributor

alexec commented May 27, 2021

@rwong2888 I've create a fix for you problem.

Could I ask you to test it?

You'll need to use argoproj/argoexec:dev-root as your executor image.

@alexec alexec modified the milestones: v3.1, v3.0 May 27, 2021
@alexec alexec added type/regression Regression from previous behavior (a specific type of bug) more-information-needed labels May 27, 2021
@rwong2888
Copy link
Contributor Author

Looks improved, but unable to kill

time="2021-05-27T12:56:10.579Z" level=info msg="Starting Workflow Executor" executorType=pns version=untagged
time="2021-05-27T12:56:10.582Z" level=info msg="Creating PNS executor (namespace: argo, pod: ci-9p5gm-2456361559, pid: 68)"
time="2021-05-27T12:56:10.582Z" level=info msg="Creating a K8sAPI executor"
time="2021-05-27T12:56:10.583Z" level=info msg="Executor initialized" includeScriptOutput=false namespace=argo podName=ci-9p5gm-2456361559 template="{\"name\":\"git-clone\",\"inputs\":{\"parameters\":[{\"name\":\"repo\",\"value\":\"https://github.com/Forbes-Media/dp-seal.git\"},{\"name\":\"revision\",\"value\":\"main\"},{\"name\":\"generate-artifactory-credentials\",\"value\":\"false\"}],\"artifacts\":[{\"name\":\"argo-source\",\"path\":\"/src\",\"git\":{\"repo\":\"https://github.com/Forbes-Media/dp-seal.git\",\"revision\":\"main\",\"usernameSecret\":{\"name\":\"github-creds\",\"key\":\"username\"},\"passwordSecret\":{\"name\":\"github-creds\",\"key\":\"password\"}}}]},\"outputs\":{\"artifacts\":[{\"name\":\"src\",\"path\":\"/src\",\"globalName\":\"src\"},{\"name\":\"git-labels\",\"path\":\"/tmp/git-labels\",\"globalName\":\"git-labels\"}]},\"metadata\":{\"annotations\":{\"vault.hashicorp.com/agent-inject\":\"true\",\"vault.hashicorp.com/agent-inject-secret-npmrc\":\"kv/data/operations/argo/jfrog\",\"vault.hashicorp.com/agent-inject-template-npmrc\":\"{{- with secret \\\"kv/data/operations/argo/jfrog\\\" -}}\\n  {{ .Data.data.npmrc }}\\n{{- end }}\\n\",\"vault.hashicorp.com/auth-path\":\"/auth/development-playground\",\"vault.hashicorp.com/role\":\"operations-read-only\",\"vault.hashicorp.com/secret-volume-path\":\"/tmp/vault\"}},\"container\":{\"name\":\"\",\"image\":\"forbes-docker.jfrog.io/alpine/git:latest\",\"command\":[\"sh\",\"-c\"],\"args\":[\"if [[ \\\"false\\\" == \\\"true\\\" ]]; then\\n  cp /tmp/vault/secrets/npmrc ./.npmrc\\nfi\\n# spaces bad for clobber-args\\n# GIT_AUTHOR_NAME=$(git log -1 --pretty=format:'%an')\\nGIT_AUTHOR_EMAIL=$(git log -1 --pretty=format:'%ae')\\n# GIT_COMMIT_MESSAGE=$(git log -1 --pretty=%B | head -1)\\nGIT_COMMIT_HASH=$(git log -1 --format=\\\"%H\\\")\\nOUTPUT=/tmp/git-labels\\necho \\\"GIT_REPO=\\\\\\\"https://github.com/Forbes-Media/dp-seal.git\\\\\\\"\\\" | tee -a ${OUTPUT}\\necho \\\"GIT_REVISION=\\\\\\\"main\\\\\\\"\\\" | tee -a ${OUTPUT}\\n# echo \\\"GIT_AUTHOR_NAME=\\\\\\\"${GIT_AUTHOR_NAME}\\\\\\\"\\\" | tee -a ${OUTPUT}\\necho \\\"GIT_AUTHOR_EMAIL=\\\\\\\"${GIT_AUTHOR_EMAIL}\\\\\\\"\\\" | tee -a ${OUTPUT}\\n# echo \\\"GIT_COMMIT_MESSAGE=\\\\\\\"${GIT_COMMIT_MESSAGE}\\\\\\\"\\\" | tee -a ${OUTPUT}\\necho \\\"GIT_COMMIT_HASH=\\\\\\\"${GIT_COMMIT_HASH}\\\\\\\"\\\" | tee -a ${OUTPUT}\"],\"workingDir\":\"/src\",\"resources\":{},\"volumeMounts\":[{\"name\":\"tmp\",\"mountPath\":\"/tmp\"}]},\"volumes\":[{\"name\":\"tmp\",\"emptyDir\":{}}],\"archiveLocation\":{\"gcs\":{\"bucket\":\"argo-artifact-repository\",\"key\":\"ci-9p5gm/ci-9p5gm-2456361559\"}}}" version="&Version{Version:untagged,BuildDate:2021-05-27T00:15:49Z,GitCommit:0d7a119bc4302e1e35930dab64ec3b5e9cec39fe,GitTag:untagged,GitTreeState:clean,GoVersion:go1.15.7,Compiler:gc,Platform:linux/amd64,}"
time="2021-05-27T12:56:10.583Z" level=info msg="Starting annotations monitor"
time="2021-05-27T12:56:10.583Z" level=info msg="Starting deadline monitor"
time="2021-05-27T12:56:12.251Z" level=warning msg="failed to secure root file handle for 100" error="open /proc/100/root: permission denied"
time="2021-05-27T12:56:12.301Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:12.301Z" level=info msg="mapped container name \"pid/100\" to pid 100"
time="2021-05-27T12:56:12.352Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:12.402Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:12.453Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:12.504Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:12.554Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:12.605Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:12.655Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:12.706Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:12.757Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:12.807Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:12.858Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:12.909Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:12.959Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.010Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.060Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.111Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.162Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.212Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.263Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.313Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.364Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.415Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.466Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.517Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.567Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.618Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.668Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.719Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.769Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.820Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.870Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.921Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:13.972Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.022Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.073Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.123Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.174Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.225Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.275Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.326Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.376Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.427Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.478Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.528Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.579Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.629Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.680Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.731Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.781Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.832Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.882Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.933Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:14.984Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.034Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.085Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.135Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.186Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.237Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.287Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.338Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.388Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.439Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.490Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.540Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.589Z" level=info msg="Watch pods 200"
time="2021-05-27T12:56:15.591Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.599Z" level=info msg="Main container completed"
time="2021-05-27T12:56:15.599Z" level=info msg="No Script output reference in workflow. Capturing script output ignored"
time="2021-05-27T12:56:15.599Z" level=info msg="No output parameters"
time="2021-05-27T12:56:15.599Z" level=info msg="Saving output artifacts"
time="2021-05-27T12:56:15.599Z" level=info msg="Staging artifact: src"
time="2021-05-27T12:56:15.599Z" level=info msg="Staging /src from mirrored volume mount /mainctrfs/src"
time="2021-05-27T12:56:15.599Z" level=info msg="Taring /mainctrfs/src"
time="2021-05-27T12:56:15.642Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.692Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.743Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.794Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.845Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.895Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.946Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:15.997Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.047Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.098Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.149Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.199Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.250Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.301Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.351Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.402Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.443Z" level=info msg="archived 82 files/dirs in /mainctrfs/src"
time="2021-05-27T12:56:16.444Z" level=info msg="Successfully staged /src from mirrored volume mount /mainctrfs/src"
time="2021-05-27T12:56:16.444Z" level=info msg="GCS Save path: /tmp/argo/outputs/artifacts/src.tgz, key: ci-9p5gm/ci-9p5gm-2456361559/src.tgz"
time="2021-05-27T12:56:16.452Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.503Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.554Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.604Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.658Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.709Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.759Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.810Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.860Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.911Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:16.961Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.012Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.063Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.113Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.164Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.214Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.265Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.316Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.366Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.395Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/artifacts/src.tgz
time="2021-05-27T12:56:17.395Z" level=info msg="Successfully saved file: /tmp/argo/outputs/artifacts/src.tgz"
time="2021-05-27T12:56:17.395Z" level=info msg="Staging artifact: git-labels"
time="2021-05-27T12:56:17.395Z" level=info msg="Staging /tmp/git-labels from mirrored volume mount /mainctrfs/tmp/git-labels"
time="2021-05-27T12:56:17.395Z" level=info msg="Taring /mainctrfs/tmp/git-labels"
time="2021-05-27T12:56:17.396Z" level=info msg="Successfully staged /tmp/git-labels from mirrored volume mount /mainctrfs/tmp/git-labels"
time="2021-05-27T12:56:17.396Z" level=info msg="GCS Save path: /tmp/argo/outputs/artifacts/git-labels.tgz, key: ci-9p5gm/ci-9p5gm-2456361559/git-labels.tgz"
time="2021-05-27T12:56:17.417Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.467Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.518Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.569Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.593Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/artifacts/git-labels.tgz
time="2021-05-27T12:56:17.593Z" level=info msg="Successfully saved file: /tmp/argo/outputs/artifacts/git-labels.tgz"
time="2021-05-27T12:56:17.593Z" level=info msg="Annotating pod with output"
time="2021-05-27T12:56:17.611Z" level=info msg="Patch pods 200"
time="2021-05-27T12:56:17.613Z" level=info msg="Killing sidecars [\"pid/100\"]"
time="2021-05-27T12:56:17.619Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.620Z" level=info msg="Get pods 200"
time="2021-05-27T12:56:17.621Z" level=info msg="Sending SIGTERM to pid 100"
time="2021-05-27T12:56:17.621Z" level=warning msg="Failed to SIGTERM pid 100: operation not permitted"
time="2021-05-27T12:56:17.670Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.720Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.770Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.821Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.872Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.922Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:17.973Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.023Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.074Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.124Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.175Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.225Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.276Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.327Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.377Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.428Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.478Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.529Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.579Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.630Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.680Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.731Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.782Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.832Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.883Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.934Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:18.984Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.035Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.085Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.136Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.186Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.237Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.287Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.338Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.389Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.439Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.490Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.540Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.591Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.642Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.692Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.743Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.793Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.844Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.895Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.945Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:19.996Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.046Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.097Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.148Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.198Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.249Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.299Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.350Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.401Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.451Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.502Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.552Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.583Z" level=info msg="/argo/podmetadata/annotations updated"
time="2021-05-27T12:56:20.603Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.653Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.704Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.755Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.805Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.856Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.906Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:20.957Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.007Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.058Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.108Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.159Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.210Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.260Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.311Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.361Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.412Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.462Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.513Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.563Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.614Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.664Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.715Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.765Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.816Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.867Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.917Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:21.968Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.018Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.069Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.120Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.170Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.221Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.271Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.322Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.373Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.423Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.474Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.524Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.575Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.625Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.676Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.726Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.777Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.828Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.878Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.929Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:22.979Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.030Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.080Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.131Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.182Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.232Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.283Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.333Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.384Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.434Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.485Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.536Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.586Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.637Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.687Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.738Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.788Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.839Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.889Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.940Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:23.990Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.041Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.091Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.142Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.193Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.243Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.294Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.344Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.395Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.445Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.496Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.546Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.597Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.647Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.698Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.749Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.799Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.850Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.900Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:24.951Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.001Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.052Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.103Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.153Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.204Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.254Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.305Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.355Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.406Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.457Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.507Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.558Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.608Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.659Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.709Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.760Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.810Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.861Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.911Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:25.962Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.012Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.063Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.114Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.164Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.215Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.265Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.316Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.367Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.417Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.468Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.518Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.569Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.620Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.670Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.721Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.771Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.822Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.873Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.923Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:26.974Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.024Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.075Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.125Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.176Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.226Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.277Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.327Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.378Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.429Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.479Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.530Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.580Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.631Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.681Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.732Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.783Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.833Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.884Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.934Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:27.985Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.035Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.086Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.136Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.187Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.238Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.288Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.339Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.389Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.440Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.490Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.541Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.591Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.642Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.692Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.743Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.793Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.844Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.894Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.945Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:28.996Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.046Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.097Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.147Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.198Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.248Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.299Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.350Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.400Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.451Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.501Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.552Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.602Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.653Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.703Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.754Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.805Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.855Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.906Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:29.956Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.007Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.058Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.108Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.159Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.209Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.260Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.310Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.361Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.412Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.462Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.513Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.563Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.614Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.664Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.715Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.765Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.816Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.866Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.917Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:30.968Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.018Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.069Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.119Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.170Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.220Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.271Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.321Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.372Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.423Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.473Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.524Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.574Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.625Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.675Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.726Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.777Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.827Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.878Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.928Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:31.979Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.029Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.080Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.131Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.181Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.232Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.282Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.333Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.383Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.434Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.485Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.535Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.586Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.636Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.687Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.738Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.788Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.839Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.889Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.940Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:32.991Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.041Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.092Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.142Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.193Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.243Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.294Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.344Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.395Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.446Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.496Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.547Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.597Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.648Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.698Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.749Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.800Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.850Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.901Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:33.951Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.002Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.052Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.103Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.154Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.204Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.255Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.305Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.356Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.407Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.457Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.508Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.558Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.609Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.660Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.710Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.761Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.811Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.862Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.913Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:34.963Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.014Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.065Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.115Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.166Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.216Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.267Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.317Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.368Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.418Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.469Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.519Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.570Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.621Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.671Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.722Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.772Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.823Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.874Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.924Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:35.975Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.026Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.076Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.127Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.177Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.228Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.278Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.329Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.380Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.430Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.481Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.531Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.582Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.633Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.683Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.734Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.784Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.835Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.886Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.936Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:36.987Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.037Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.088Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.139Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.189Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.240Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.290Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.341Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.392Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.442Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.493Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.543Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.594Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.644Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.695Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.746Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.796Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.847Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.897Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.948Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:37.998Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.049Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.100Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.150Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.201Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.252Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.302Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.353Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.403Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.454Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.504Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.555Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.606Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.656Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.707Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.758Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.808Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.859Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.909Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:38.960Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.010Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.061Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.111Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.162Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.213Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.263Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.314Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.365Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.415Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.466Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.516Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.567Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.618Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.668Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.719Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.769Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.820Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.870Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.921Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:39.972Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.022Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.073Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.123Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.174Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.225Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.275Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.326Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.376Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.427Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.478Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.528Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.579Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.629Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.680Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.731Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.781Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.832Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.882Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.933Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:40.984Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.034Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.085Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.135Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.186Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.237Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.287Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.338Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.389Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.439Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.490Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.541Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.591Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.642Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.692Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.743Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.794Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.844Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.895Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.945Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:41.996Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.047Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.097Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.148Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.198Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.249Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.300Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.350Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.401Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.452Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.502Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.553Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.604Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.654Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.705Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.756Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.806Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.857Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.908Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:42.958Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.009Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.059Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.110Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.161Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.211Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.262Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.312Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.363Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.414Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.464Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.515Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.565Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.616Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.667Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.717Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.768Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.818Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.869Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.920Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:43.970Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.021Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.071Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.122Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.173Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.223Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.274Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.325Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.375Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.426Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.477Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.527Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.578Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.628Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.679Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.729Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.780Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.831Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.881Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.932Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:44.983Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.033Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.084Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.135Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.186Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.236Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.287Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.337Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.388Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.438Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.489Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.540Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.590Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.641Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.691Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.742Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.792Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.843Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.893Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.944Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:45.994Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.045Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.095Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.146Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.196Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.247Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.298Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.348Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.399Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.450Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.500Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.551Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.601Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.652Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.702Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.753Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.804Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.854Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.905Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:46.956Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:47.006Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:47.057Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:47.108Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:47.158Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:47.209Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:47.259Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:47.310Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:47.361Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:47.411Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:47.462Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:47.512Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:47.563Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:47.614Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T12:56:47.621Z" level=warning msg="Timed out (30s) waiting for pid 100 to complete after SIGTERM. Issuing SIGKILL"
time="2021-05-27T12:56:47.621Z" level=warning msg="Failed to SIGKILL pid 100: operation not permitted"
time="2021-05-27T12:56:47.621Z" level=info msg="Alloc=7499 TotalAlloc=81033 Sys=73873 NumGC=9 Goroutines=14"

@alexec
Copy link
Contributor

alexec commented May 27, 2021

OK. So we need to do more. Not only does the argoexec binary not have the permission to read the other user's file, but it also does not have permission to kill it. I suspect you need both.

I've just pushed changes that logs out more diagnostics (group/user ID/group ID). Could you please run it?

@jessesuen any thoughts on this?

@rwong2888
Copy link
Contributor Author

Waiting for new image to build. In the meantime, if anyone needs to follow along.

Added executor to pull always to workflow-controller-configmap

apiVersion: v1
data:
  artifactRepository: |
    ...
  containerRuntimeExecutor: pns
  executor: |
    imagePullPolicy: Always
  workflowDefaults: |
    spec:
      securityContext:
        runAsNonRoot: true
        runAsUser: 8737
kind: ConfigMap
metadata:
  name: workflow-controller-configmap
  namespace: argo

Added dev-root image to workflow-controller deployment.

    spec:
      containers:
      - args:
        - --configmap
        - workflow-controller-configmap
        - --executor-image
        - argoproj/argoexec:dev-root

@rwong2888
Copy link
Contributor Author 

time="2021-05-27T19:07:45.130Z" level=info msg="Starting Workflow Executor" executorType=pns gid=0 groups="[]" pid=67 uid=8737 version=untagged
time="2021-05-27T19:07:45.134Z" level=info msg="Creating PNS executor (namespace: argo, pod: ci-nbrqs-3380519161, pid: 67)"
time="2021-05-27T19:07:45.134Z" level=info msg="Creating a K8sAPI executor"
time="2021-05-27T19:07:45.134Z" level=info msg="Executor initialized" includeScriptOutput=false namespace=argo podName=ci-nbrqs-3380519161 template="{\"name\":\"git-clone\",\"inputs\":{\"parameters\":[{\"name\":\"repo\",\"value\":\"https://github.com/Forbes-Media/dp-seal.git\"},{\"name\":\"revision\",\"value\":\"main\"},{\"name\":\"generate-artifactory-credentials\",\"value\":\"false\"}],\"artifacts\":[{\"name\":\"argo-source\",\"path\":\"/src\",\"git\":{\"repo\":\"https://github.com/Forbes-Media/dp-seal.git\",\"revision\":\"main\",\"usernameSecret\":{\"name\":\"github-creds\",\"key\":\"username\"},\"passwordSecret\":{\"name\":\"github-creds\",\"key\":\"password\"}}}]},\"outputs\":{\"artifacts\":[{\"name\":\"src\",\"path\":\"/src\",\"globalName\":\"src\"},{\"name\":\"git-labels\",\"path\":\"/tmp/git-labels\",\"globalName\":\"git-labels\"}]},\"metadata\":{\"annotations\":{\"vault.hashicorp.com/agent-inject\":\"true\",\"vault.hashicorp.com/agent-inject-secret-npmrc\":\"kv/data/operations/argo/jfrog\",\"vault.hashicorp.com/agent-inject-template-npmrc\":\"{{- with secret \\\"kv/data/operations/argo/jfrog\\\" -}}\\n  {{ .Data.data.npmrc }}\\n{{- end }}\\n\",\"vault.hashicorp.com/auth-path\":\"/auth/development-playground\",\"vault.hashicorp.com/role\":\"operations-read-only\",\"vault.hashicorp.com/secret-volume-path\":\"/tmp/vault\"}},\"container\":{\"name\":\"\",\"image\":\"forbes-docker.jfrog.io/alpine/git:latest\",\"command\":[\"sh\",\"-c\"],\"args\":[\"if [[ \\\"false\\\" == \\\"true\\\" ]]; then\\n  cp /tmp/vault/secrets/npmrc ./.npmrc\\nfi\\n# spaces bad for clobber-args\\n# GIT_AUTHOR_NAME=$(git log -1 --pretty=format:'%an')\\nGIT_AUTHOR_EMAIL=$(git log -1 --pretty=format:'%ae')\\n# GIT_COMMIT_MESSAGE=$(git log -1 --pretty=%B | head -1)\\nGIT_COMMIT_HASH=$(git log -1 --format=\\\"%H\\\")\\nOUTPUT=/tmp/git-labels\\necho \\\"GIT_REPO=\\\\\\\"https://github.com/Forbes-Media/dp-seal.git\\\\\\\"\\\" | tee -a ${OUTPUT}\\necho \\\"GIT_REVISION=\\\\\\\"main\\\\\\\"\\\" | tee -a ${OUTPUT}\\n# echo \\\"GIT_AUTHOR_NAME=\\\\\\\"${GIT_AUTHOR_NAME}\\\\\\\"\\\" | tee -a ${OUTPUT}\\necho \\\"GIT_AUTHOR_EMAIL=\\\\\\\"${GIT_AUTHOR_EMAIL}\\\\\\\"\\\" | tee -a ${OUTPUT}\\n# echo \\\"GIT_COMMIT_MESSAGE=\\\\\\\"${GIT_COMMIT_MESSAGE}\\\\\\\"\\\" | tee -a ${OUTPUT}\\necho \\\"GIT_COMMIT_HASH=\\\\\\\"${GIT_COMMIT_HASH}\\\\\\\"\\\" | tee -a ${OUTPUT}\"],\"workingDir\":\"/src\",\"resources\":{},\"volumeMounts\":[{\"name\":\"tmp\",\"mountPath\":\"/tmp\"}]},\"volumes\":[{\"name\":\"tmp\",\"emptyDir\":{}}],\"archiveLocation\":{\"gcs\":{\"bucket\":\"argo-artifact-repository\",\"key\":\"ci-nbrqs/ci-nbrqs-3380519161\"}}}" version="&Version{Version:untagged,BuildDate:2021-05-27T16:12:52Z,GitCommit:2aa97b9b803281b82986f8b285f0b0cfd5ff50fb,GitTag:untagged,GitTreeState:clean,GoVersion:go1.15.7,Compiler:gc,Platform:linux/amd64,}"
time="2021-05-27T19:07:45.135Z" level=info msg="Starting annotations monitor"
time="2021-05-27T19:07:45.135Z" level=info msg="Starting deadline monitor"
time="2021-05-27T19:07:46.196Z" level=warning msg="failed to secure root file handle for 84" error="open /proc/84/root: permission denied"
time="2021-05-27T19:07:46.348Z" level=warning msg="failed to secure root file handle for 100" error="open /proc/100/root: permission denied"
time="2021-05-27T19:07:46.399Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:46.399Z" level=info msg="mapped container name \"pid/100\" to pid 100"
time="2021-05-27T19:07:46.449Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:46.500Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:46.551Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:46.601Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:46.652Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:46.703Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:46.753Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:46.804Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:46.855Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:46.905Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:46.956Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.007Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.058Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.108Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.159Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.210Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.260Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.311Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.362Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.412Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.463Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.514Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.565Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.615Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.666Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.717Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.767Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.818Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.868Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.919Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:47.970Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.020Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.071Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.122Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.172Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.223Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.274Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.324Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.375Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.426Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.476Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.527Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.577Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.628Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.679Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.729Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.780Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.831Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.881Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.932Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:48.983Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.033Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.084Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.135Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.185Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.236Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.286Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.337Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.388Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.438Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.489Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.540Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.591Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.641Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.692Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.743Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.793Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.844Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.895Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.945Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:49.996Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.046Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.097Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.144Z" level=info msg="Watch pods 200"
time="2021-05-27T19:07:50.148Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.154Z" level=info msg="Main container completed"
time="2021-05-27T19:07:50.154Z" level=info msg="No Script output reference in workflow. Capturing script output ignored"
time="2021-05-27T19:07:50.154Z" level=info msg="No output parameters"
time="2021-05-27T19:07:50.154Z" level=info msg="Saving output artifacts"
time="2021-05-27T19:07:50.155Z" level=info msg="Staging artifact: src"
time="2021-05-27T19:07:50.155Z" level=info msg="Staging /src from mirrored volume mount /mainctrfs/src"
time="2021-05-27T19:07:50.155Z" level=info msg="Taring /mainctrfs/src"
time="2021-05-27T19:07:50.199Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.249Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.300Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.351Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.401Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.452Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.503Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.553Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.604Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.655Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.706Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.756Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.807Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.858Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.908Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:50.960Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.006Z" level=info msg="archived 82 files/dirs in /mainctrfs/src"
time="2021-05-27T19:07:51.006Z" level=info msg="Successfully staged /src from mirrored volume mount /mainctrfs/src"
time="2021-05-27T19:07:51.006Z" level=info msg="GCS Save path: /tmp/argo/outputs/artifacts/src.tgz, key: ci-nbrqs/ci-nbrqs-3380519161/src.tgz"
time="2021-05-27T19:07:51.016Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.066Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.117Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.168Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.220Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.270Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.321Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.371Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.422Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.473Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.524Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.574Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.625Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.676Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.726Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.777Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.828Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.879Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.929Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:51.980Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.031Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.081Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.130Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/artifacts/src.tgz
time="2021-05-27T19:07:52.130Z" level=info msg="Successfully saved file: /tmp/argo/outputs/artifacts/src.tgz"
time="2021-05-27T19:07:52.130Z" level=info msg="Staging artifact: git-labels"
time="2021-05-27T19:07:52.130Z" level=info msg="Staging /tmp/git-labels from mirrored volume mount /mainctrfs/tmp/git-labels"
time="2021-05-27T19:07:52.130Z" level=info msg="Taring /mainctrfs/tmp/git-labels"
time="2021-05-27T19:07:52.131Z" level=info msg="Successfully staged /tmp/git-labels from mirrored volume mount /mainctrfs/tmp/git-labels"
time="2021-05-27T19:07:52.131Z" level=info msg="GCS Save path: /tmp/argo/outputs/artifacts/git-labels.tgz, key: ci-nbrqs/ci-nbrqs-3380519161/git-labels.tgz"
time="2021-05-27T19:07:52.133Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.183Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.234Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.285Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.288Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/artifacts/git-labels.tgz
time="2021-05-27T19:07:52.288Z" level=info msg="Successfully saved file: /tmp/argo/outputs/artifacts/git-labels.tgz"
time="2021-05-27T19:07:52.288Z" level=info msg="Annotating pod with output"
time="2021-05-27T19:07:52.320Z" level=info msg="Patch pods 200"
time="2021-05-27T19:07:52.322Z" level=info msg="Killing sidecars [\"pid/100\"]"
time="2021-05-27T19:07:52.330Z" level=info msg="Get pods 200"
time="2021-05-27T19:07:52.331Z" level=info msg="Sending SIGTERM to pid 100"
time="2021-05-27T19:07:52.331Z" level=warning msg="Failed to SIGTERM pid 100: operation not permitted"
time="2021-05-27T19:07:52.335Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.386Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.436Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.487Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.538Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.588Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.639Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.690Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.740Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.791Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.842Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.892Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.943Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:52.993Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.044Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.095Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.145Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.196Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.247Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.297Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.348Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.398Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.449Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.500Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.550Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.601Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.651Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.702Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.753Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.804Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.854Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.905Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:53.956Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.006Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.057Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.108Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.158Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.209Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.260Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.310Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.361Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.412Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.462Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.513Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.564Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.614Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.665Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.716Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.766Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.817Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.868Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.918Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:54.969Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.020Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.071Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.121Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.135Z" level=info msg="/argo/podmetadata/annotations updated"
time="2021-05-27T19:07:55.172Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.222Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.273Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.324Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.374Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.425Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.476Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.526Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.577Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.628Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.678Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.729Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.780Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.830Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.881Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.931Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:55.982Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.033Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.083Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.134Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.185Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.235Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.286Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.337Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.387Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.438Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.489Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.539Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.590Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.640Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.691Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.742Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.792Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.843Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.894Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.944Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:56.995Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.046Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.096Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.147Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.197Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.248Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.299Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.349Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.400Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.451Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.501Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.552Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.602Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.653Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.704Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.754Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.805Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.855Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.906Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:57.957Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.007Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.058Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.109Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.159Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.210Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.261Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.311Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.362Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.413Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.463Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.514Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.564Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.615Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.666Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.716Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.767Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.818Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.868Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.919Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:58.970Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.020Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.071Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.121Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.172Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.223Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.273Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.324Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.375Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.425Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.476Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.527Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.577Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.628Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.679Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.729Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.780Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.831Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.881Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.932Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:07:59.983Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.033Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.084Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.135Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.185Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.236Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.287Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.337Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.388Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.439Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.489Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.540Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.591Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.641Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.692Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.743Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.793Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.844Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.895Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.945Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:00.996Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.046Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.097Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.148Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.198Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.249Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.299Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.350Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.401Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.451Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.502Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.552Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.603Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.654Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.705Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.755Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.806Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.856Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.907Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:01.958Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.008Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.059Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.110Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.160Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.211Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.261Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.312Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.363Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.413Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.464Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.515Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.565Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.616Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.667Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.717Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.768Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.819Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.869Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.920Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:02.971Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.021Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.072Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.122Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.173Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.224Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.275Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.325Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.376Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.426Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.477Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.528Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.578Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.629Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.680Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.730Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.781Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.832Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.882Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.933Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:03.984Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.034Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.085Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.136Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.186Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.237Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.287Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.338Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.388Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.439Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.490Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.540Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.591Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.642Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.692Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.743Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.794Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.844Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.895Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.945Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:04.996Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.047Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.097Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.148Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.199Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.249Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.300Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.350Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.401Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.452Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.502Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.553Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.603Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.654Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.704Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.755Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.806Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.856Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.907Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:05.957Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.008Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.058Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.109Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.160Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.210Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.261Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.312Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.362Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.413Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.464Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.515Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.565Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.616Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.667Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.717Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.768Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.819Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.869Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.920Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:06.970Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.021Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.072Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.122Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.173Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.224Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.274Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.325Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.375Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.426Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.477Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.527Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.578Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.629Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.679Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.730Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.781Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.832Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.882Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.933Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:07.984Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.034Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.085Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.136Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.186Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.237Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.288Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.338Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.389Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.439Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.490Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.541Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.591Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.642Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.693Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.743Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.794Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.845Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.895Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.946Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:08.996Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.047Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.098Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.148Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.199Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.250Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.300Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.351Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.402Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.452Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.503Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.554Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.604Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.655Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.706Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.756Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.807Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.858Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.908Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:09.959Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.009Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.060Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.111Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.161Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.212Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.263Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.313Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.364Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.414Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.465Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.516Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.566Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.617Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.668Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.718Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.769Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.820Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.870Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.921Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:10.971Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.022Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.073Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.123Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.174Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.225Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.275Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.326Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.377Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.427Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.478Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.528Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.579Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.630Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.681Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.731Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.782Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.833Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.884Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.934Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:11.985Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.036Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.086Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.137Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.188Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.238Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.289Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.340Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.390Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.441Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.492Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.542Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.593Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.644Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.695Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.745Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.796Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.847Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.897Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.948Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:12.999Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.049Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.100Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.151Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.201Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.252Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.303Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.353Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.404Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.454Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.505Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.556Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.606Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.657Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.708Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.758Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.809Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.860Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.911Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:13.961Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.012Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.062Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.113Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.164Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.214Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.265Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.316Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.366Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.417Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.467Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.518Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.569Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.619Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.670Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.721Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.772Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.822Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.873Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.924Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:14.974Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.025Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.076Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.126Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.177Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.228Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.278Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.329Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.380Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.430Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.481Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.532Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.582Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.633Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.683Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.734Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.785Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.836Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.886Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.937Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:15.988Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.038Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.089Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.140Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.190Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.241Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.292Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.342Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.393Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.444Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.494Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.545Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.596Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.646Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.697Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.747Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.798Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.849Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.899Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:16.950Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.001Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.051Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.102Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.152Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.203Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.254Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.304Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.355Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.405Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.456Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.507Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.558Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.608Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.659Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.709Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.760Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.811Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.862Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.912Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:17.963Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.014Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.064Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.115Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.166Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.216Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.267Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.318Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.368Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.419Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.470Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.521Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.571Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.622Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.673Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.723Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.774Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.825Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.875Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.926Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:18.977Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.027Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.078Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.129Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.179Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.230Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.281Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.331Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.382Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.433Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.483Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.534Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.585Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.635Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.686Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.737Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.787Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.838Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.889Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.940Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:19.991Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.041Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.092Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.142Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.193Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.244Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.294Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.345Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.396Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.447Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.497Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.548Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.598Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.649Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.699Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.750Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.801Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.851Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.902Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:20.952Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.003Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.053Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.104Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.155Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.205Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.256Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.306Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.357Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.408Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.458Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.509Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.559Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.610Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.661Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.711Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.762Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.812Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.863Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.913Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:21.964Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:22.015Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:22.065Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:22.116Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:22.167Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:22.217Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:22.268Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:22.319Z" level=info msg="secured root for pid 100 root: vault (\"/proc/100/root\")"
time="2021-05-27T19:08:22.331Z" level=warning msg="Timed out (30s) waiting for pid 100 to complete after SIGTERM. Issuing SIGKILL"
time="2021-05-27T19:08:22.332Z" level=warning msg="Failed to SIGKILL pid 100: operation not permitted"
time="2021-05-27T19:08:22.332Z" level=info msg="Alloc=7301 TotalAlloc=81066 Sys=73873 NumGC=9 Goroutines=14"

@alexec
Copy link
Contributor

alexec commented May 27, 2021 

gid=0 groups="[]" pid=67 uid=8737

I'm not sure this is fixable, the injected sidecar will be running with another user ID presumably?

Can you confirm?

@rwong2888
Copy link
Contributor Author

I exec'd into the vault sidecar and see this.

/ $ id
uid=100(vault) gid=1000(vault)

I think I can change the user with an annotation:
https://www.vaultproject.io/docs/platform/k8s/injector/annotations#vault-hashicorp-com-agent-run-as-user
https://www.vaultproject.io/docs/platform/k8s/injector/annotations#vault-hashicorp-com-agent-run-as-same-user

@rwong2888
Copy link
Contributor Author

I was able to progress further with below set up. But it is now failing on output results.

  workflowDefaults: |
    spec:
      securityContext:
        runAsNonRoot: true
        runAsUser: 8737
        runAsGroup: 8737

vault.hashicorp.com/agent-run-as-user: "8737"
vault.hashicorp.com/agent-run-as-group: "8737"

STEP                      TEMPLATE                 PODNAME              DURATION  MESSAGE
 ✖ ci-kjf5k               ci                                                      child 'ci-kjf5k-769547737' failed
 └───✖ ci                 ci/ci                                                   child 'ci-kjf5k-1523237450' failed
     ├───✔ git-clone-src  git-clone/git-clone      ci-kjf5k-4057371904  14s
     └───✖ build-image    build-image/build-image                                 step group deemed errored due to child ci-kjf5k[0].ci[1].build-image[0].generate-image-tag error: cannot fetch result from <nil> (1:47)
 | steps['echo-salt-and-hash-image-tag'].outputs.result == 'true' ? steps['salt-and-hash-image-tag'].outputs.result : steps['echo-image-tag'].outputs.result
 | ..............................................^
         └─┬─⚠ generate-image-tag          generate-image-tag/generate-image-tag      cannot fetch result from <nil> (1:47)
 | steps['echo-salt-and-hash-image-tag'].outputs.result == 'true' ? steps['salt-and-hash-image-tag'].outputs.result : steps['echo-image-tag'].outputs.result
 | ..............................................^
           │ ├───✔ echo-salt-and-hash-image-tag  echo/echo                                    ci-kjf5k-3151044974  8s
           │ └─┬─○ echo-image-tag                echo/echo                                                              when ''true' != 'true'' evaluated false
           │   └─✔ salt-and-hash-image-tag       salt-and-hash/salt-and-hash                  ci-kjf5k-975407163   7s
           └─✔ generate-image-labels             generate-image-labels/generate-image-labels  ci-kjf5k-2598819947  12s

Side note:

run-as-same-user yields below.

STEP                      TEMPLATE             PODNAME             DURATION  MESSAGE
 ✖ ci-ltz9x               ci                                                 child 'ci-ltz9x-3722348939' failed
 └───✖ ci                 ci/ci                                              step group deemed errored due to child ci-ltz9x[0].ci[0].git-clone-src error: admission webhook "vault.hashicorp.com" denied the request: error creating new agent sidecar: RunAsUser is nil for Container 0's SecurityContext
     └───⚠ git-clone-src  git-clone/git-clone  ci-ltz9x-407123106  0s        admission webhook "vault.hashicorp.com" denied the request: error creating new agent sidecar: RunAsUser is nil for Container 0's SecurityContext

@alexec
Copy link
Contributor

alexec commented May 27, 2021

This looks like the vault webhook is preventing creating of the workflow pod?

@rwong2888
Copy link
Contributor Author

rwong2888 commented May 27, 2021 •
edited
Loading

The side note is just informative.
I was able to get past the vault issues in the git-clone step by setting the uid and gid for the vault container.
However, my workflow is now failing on cannot fetch result from <nil>

      outputs:
        parameters:
          - name: generated-image-tag
            valueFrom:
              expression: "steps['echo-salt-and-hash-image-tag'].outputs.result == 'true' ? steps['salt-and-hash-image-tag'].outputs.result : steps['echo-image-tag'].outputs.result"

@alexec
Copy link
Contributor

alexec commented May 27, 2021

wait container logs?

@rwong2888
Copy link
Contributor Author

rwong2888 commented May 27, 2021 •
edited
Loading

I reverted the executor back to v3.1.0-rc8 and it is passing the previous error. It is now failing on kaniko step.

Kaniko needs to run as root, but is not overriding the workflow defaults.

---
apiVersion: argoproj.io/v1alpha1
kind: WorkflowTemplate
metadata:
  name: kaniko
spec:
  entrypoint: kaniko
  securityContext:
    runAsNonRoot: false
    runAsUser: 0
    runAsGroup: 0
  templates:
    - name: kaniko
      container:
        image: gcr.io/kaniko-project/executor:v1.6.0
        workingDir: /src
        args: [...]

Error: error resolving dockerfile path: copying dockerfile: creating file: open /kaniko/Dockerfile: permission denied

time="2021-05-27T21:35:00.304Z" level=info msg="Starting Workflow Executor" executorType=pns version=v3.1.0-rc8
time="2021-05-27T21:35:00.311Z" level=info msg="Creating PNS executor (namespace: argo, pod: ci-9tzbn-2629749415, pid: 22)"
time="2021-05-27T21:35:00.311Z" level=info msg="Creating a K8sAPI executor"
time="2021-05-27T21:35:00.311Z" level=info msg="Executor (version: v3.1.0-rc8, build_date: 2021-05-25T15:15:42Z) initialized (pod: argo/ci-9tzbn-2629749415) with template:\n{\"name\":\"kaniko\",\"inputs\":{\"parameters\":[{\"name\":\"kaniko-args\"
time="2021-05-27T21:35:00.311Z" level=info msg="Starting annotations monitor"
time="2021-05-27T21:35:00.312Z" level=info msg="Starting deadline monitor"
time="2021-05-27T21:35:00.464Z" level=warning msg="failed to secure root file handle for 37" error="open /proc/37/root: permission denied"
time="2021-05-27T21:35:00.515Z" level=info msg="secured root for pid 37 root: executor (\"/proc/37/root\")"
time="2021-05-27T21:35:00.515Z" level=info msg="mapped container name \"main\" to pid 37"
time="2021-05-27T21:35:01.320Z" level=info msg="Watch pods 200"
time="2021-05-27T21:35:01.334Z" level=info msg="Main container completed"
time="2021-05-27T21:35:01.334Z" level=info msg="No Script output reference in workflow. Capturing script output ignored"
time="2021-05-27T21:35:01.334Z" level=info msg="No output parameters"
time="2021-05-27T21:35:01.334Z" level=info msg="No output artifacts"
time="2021-05-27T21:35:01.335Z" level=info msg="Killing sidecars []"
time="2021-05-27T21:35:01.335Z" level=info msg="Alloc=5212 TotalAlloc=10822 Sys=73297 NumGC=4 Goroutines=9"

@alexec
Copy link
Contributor

alexec commented May 31, 2021

Can I ask you to try using the Emissary executor?

We need to make a value call on this, and it might not be possible or easy to get this working with PNS, and if Emissary works for you, I don't really see that we need to fix PNS. You'll need to be running v3.1.

@alexec alexec added more-information-needed and removed type/regression Regression from previous behavior (a specific type of bug) labels May 31, 2021
@rwong2888
Copy link
Contributor Author

Emissary is not killing the vault sidecar and not able to pass the first step in the workflow.

time="2021-06-01T13:24:33.195Z" level=info msg="Starting Workflow Executor" executorType=emissary version=v3.1.0-rc10
time="2021-06-01T13:24:33.199Z" level=info msg="Executor initialized" includeScriptOutput=false namespace=argo podName=ci-mhv7d-319907753 template="{\"name\":\"git-clone\",\"inputs\":{\"parameters\":[{\"name\":\"repo\",\"value\":\"https://githu
time="2021-06-01T13:24:33.199Z" level=info msg="Starting annotations monitor"
time="2021-06-01T13:24:33.199Z" level=info msg="Starting deadline monitor"
time="2021-06-01T13:24:36.200Z" level=info msg="Main container completed"
time="2021-06-01T13:24:36.200Z" level=info msg="No Script output reference in workflow. Capturing script output ignored"
time="2021-06-01T13:24:36.200Z" level=info msg="No output parameters"
time="2021-06-01T13:24:36.200Z" level=info msg="Saving output artifacts"
time="2021-06-01T13:24:36.200Z" level=info msg="Staging artifact: src"
time="2021-06-01T13:24:36.200Z" level=info msg="Staging /src from mirrored volume mount /mainctrfs/src"
time="2021-06-01T13:24:36.200Z" level=info msg="Taring /mainctrfs/src"
time="2021-06-01T13:24:37.085Z" level=info msg="archived 82 files/dirs in /mainctrfs/src"
time="2021-06-01T13:24:37.085Z" level=info msg="Successfully staged /src from mirrored volume mount /mainctrfs/src"
time="2021-06-01T13:24:37.085Z" level=info msg="GCS Save path: /tmp/argo/outputs/artifacts/src.tgz, key: ci-mhv7d/ci-mhv7d-319907753/src.tgz"
time="2021-06-01T13:24:38.239Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/artifacts/src.tgz
time="2021-06-01T13:24:38.239Z" level=info msg="Successfully saved file: /tmp/argo/outputs/artifacts/src.tgz"
time="2021-06-01T13:24:38.239Z" level=info msg="Staging artifact: git-labels"
time="2021-06-01T13:24:38.239Z" level=info msg="Staging /tmp/git-labels from mirrored volume mount /mainctrfs/tmp/git-labels"
time="2021-06-01T13:24:38.240Z" level=info msg="Taring /mainctrfs/tmp/git-labels"
time="2021-06-01T13:24:38.241Z" level=info msg="Successfully staged /tmp/git-labels from mirrored volume mount /mainctrfs/tmp/git-labels"
time="2021-06-01T13:24:38.241Z" level=info msg="GCS Save path: /tmp/argo/outputs/artifacts/git-labels.tgz, key: ci-mhv7d/ci-mhv7d-319907753/git-labels.tgz"
time="2021-06-01T13:24:38.439Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/artifacts/git-labels.tgz
time="2021-06-01T13:24:38.439Z" level=info msg="Successfully saved file: /tmp/argo/outputs/artifacts/git-labels.tgz"
time="2021-06-01T13:24:38.439Z" level=info msg="Annotating pod with output"
time="2021-06-01T13:24:38.465Z" level=info msg="Patch pods 200"
time="2021-06-01T13:24:38.476Z" level=info msg="Killing sidecars []"
time="2021-06-01T13:24:38.476Z" level=info msg="Alloc=23061 TotalAlloc=55001 Sys=73553 NumGC=6 Goroutines=12"

@alexec
Copy link
Contributor

alexec commented Jun 1, 2021

I should mention you must run v3.1 controller with the emissary. Unlike other executors, the controller kills the side car. Can you check the controller logs?

@alexec
Copy link
Contributor

alexec commented Jun 1, 2021

Can you confirm which version of the workflows-controller image you're using?

@rwong2888
Copy link
Contributor Author

Yes, I see ash

@alexec
Copy link
Contributor

alexec commented Jun 2, 2021

the -1 is to kill whole process group, but must come after -- e.g kill -- -1

@alexec
Copy link
Contributor

alexec commented Jun 2, 2021

when you ran kill -15 1 kill it successfully killed the container, it should have exit code 0 too?

@alexec alexec modified the milestones: v3.0, v3.1 Jun 2, 2021
@rwong2888
Copy link
Contributor Author

I was killing within the container...

From outside.

 ❯ kubectl exec -it ci-mqgt8-1751122230 -c vault-agent -- sh -c 'kill -- -1'
sh: can't kill pid -1: No such process
command terminated with exit code 1


 ❯ kubectl exec -it ci-mqgt8-1751122230 -c vault-agent -- sh -c 'kill -15 -- -1'
sh: invalid number '--'
sh: can't kill pid -1: No such process
command terminated with exit code 2


 ❯ kubectl exec -it ci-mqgt8-1751122230 -c vault-agent -- sh -c 'kill -15 -- 1'
sh: invalid number '--'
command terminated with exit code 1

kubectl exec -it ci-mqgt8-1751122230 -c vault-agent -- sh -c 'kill -15 -- 1' did kill the vault-agent container though.

alexec added a commit that referenced this issue Jun 2, 2021
@alexec
fix(controller): Update container signaler to POSIX compliance. Fixes #…
d75de64 
…6030

Signed-off-by: Alex Collins <alex_collins@intuit.com>
@alexec alexec mentioned this issue Jun 2, 2021
Closed
@alexec
Copy link
Contributor

alexec commented Jun 3, 2021 •
edited
Loading

@rwong2888 I've created a dev build for you to test argoproj/argoexec:dev-signal. This includes a potential fix for the Emissary executor.

@alexec
Copy link
Contributor

alexec commented Jun 3, 2021

Do you think you'd please be able to test it?

alexec added a commit that referenced this issue Jun 3, 2021
@alexec
fix(controller): Update container signaler to POSIX compliance. Fixes #…
6952bb5 
…6030

Signed-off-by: Alex Collins <alex_collins@intuit.com>
alexec added a commit that referenced this issue Jun 3, 2021
@alexec
fix(executor): Fix emissary kill. Fixes #6030
338f3ba 
Signed-off-by: Alex Collins <alex_collins@intuit.com>
@alexec alexec mentioned this issue Jun 3, 2021
Merged
@rwong2888
Copy link
Contributor Author

It did not kill the vault-agent. Logs below.

time="2021-06-03T22:17:58.445Z" level=info msg="Starting Workflow Executor" executorType=emissary version=untagged
time="2021-06-03T22:17:58.449Z" level=info msg="Executor initialized" includeScriptOutput=false namespace=argo podName=ci-fgfrz-2248958894 template="{\"name\":\"git-clone\",\"inputs\":{\"parameters\":[{\"name\":\"repo\",\"value\":\"https://github.
time="2021-06-03T22:17:58.449Z" level=info msg="Starting annotations monitor"
time="2021-06-03T22:17:58.449Z" level=info msg="Starting deadline monitor"
time="2021-06-03T22:18:01.450Z" level=info msg="Main container completed"
time="2021-06-03T22:18:01.450Z" level=info msg="No Script output reference in workflow. Capturing script output ignored"
time="2021-06-03T22:18:01.450Z" level=info msg="No output parameters"
time="2021-06-03T22:18:01.450Z" level=info msg="Saving output artifacts"
time="2021-06-03T22:18:01.450Z" level=info msg="Staging artifact: src"
time="2021-06-03T22:18:01.450Z" level=info msg="Staging /src from mirrored volume mount /mainctrfs/src"
time="2021-06-03T22:18:01.450Z" level=info msg="Taring /mainctrfs/src"
time="2021-06-03T22:18:02.363Z" level=info msg="archived 82 files/dirs in /mainctrfs/src"
time="2021-06-03T22:18:02.363Z" level=info msg="Successfully staged /src from mirrored volume mount /mainctrfs/src"
time="2021-06-03T22:18:02.363Z" level=info msg="GCS Save path: /tmp/argo/outputs/artifacts/src.tgz, key: ci-fgfrz/ci-fgfrz-2248958894/src.tgz"
time="2021-06-03T22:18:03.640Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/artifacts/src.tgz
time="2021-06-03T22:18:03.640Z" level=info msg="Successfully saved file: /tmp/argo/outputs/artifacts/src.tgz"
time="2021-06-03T22:18:03.640Z" level=info msg="Staging artifact: git-labels"
time="2021-06-03T22:18:03.640Z" level=info msg="Staging /tmp/git-labels from mirrored volume mount /mainctrfs/tmp/git-labels"
time="2021-06-03T22:18:03.640Z" level=info msg="Taring /mainctrfs/tmp/git-labels"
time="2021-06-03T22:18:03.641Z" level=info msg="Successfully staged /tmp/git-labels from mirrored volume mount /mainctrfs/tmp/git-labels"
time="2021-06-03T22:18:03.641Z" level=info msg="GCS Save path: /tmp/argo/outputs/artifacts/git-labels.tgz, key: ci-fgfrz/ci-fgfrz-2248958894/git-labels.tgz"
time="2021-06-03T22:18:03.853Z" level=info msg="not deleting local artifact" localArtPath=/tmp/argo/outputs/artifacts/git-labels.tgz
time="2021-06-03T22:18:03.853Z" level=info msg="Successfully saved file: /tmp/argo/outputs/artifacts/git-labels.tgz"
time="2021-06-03T22:18:03.853Z" level=info msg="Annotating pod with output"
time="2021-06-03T22:18:03.888Z" level=info msg="Patch pods 200"
time="2021-06-03T22:18:03.899Z" level=info msg="Killing sidecars []"
time="2021-06-03T22:18:03.900Z" level=info msg="Alloc=23129 TotalAlloc=54838 Sys=73553 NumGC=6 Goroutines=12"

time="2021-06-03T22:17:06.330Z" level=info msg=healthz age=5m0s err="<nil>" instanceID= labelSelector="!workflows.argoproj.io/phase,!workflows.argoproj.io/controller-instanceid" managedNamespace=
time="2021-06-03T22:17:10.150Z" level=info msg="Get leases 200"
time="2021-06-03T22:17:10.155Z" level=info msg="Update leases 200"
time="2021-06-03T22:17:15.158Z" level=info msg="Get leases 200"
time="2021-06-03T22:17:15.164Z" level=info msg="Update leases 200"
time="2021-06-03T22:17:20.167Z" level=info msg="Get leases 200"
time="2021-06-03T22:17:20.173Z" level=info msg="Update leases 200"
time="2021-06-03T22:17:25.177Z" level=info msg="Get leases 200"
time="2021-06-03T22:17:25.183Z" level=info msg="Update leases 200"
time="2021-06-03T22:17:30.188Z" level=info msg="Get leases 200"
time="2021-06-03T22:17:30.194Z" level=info msg="Update leases 200"
time="2021-06-03T22:17:35.197Z" level=info msg="Get leases 200"
time="2021-06-03T22:17:35.203Z" level=info msg="Update leases 200"
time="2021-06-03T22:17:40.206Z" level=info msg="Get leases 200"
time="2021-06-03T22:17:40.212Z" level=info msg="Update leases 200"
time="2021-06-03T22:17:41.484Z" level=info msg="Processing workflow" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:17:41.487Z" level=info msg="Get workflowtemplates 200"
time="2021-06-03T22:17:41.497Z" level=info msg="Get workflowtemplates 200"
time="2021-06-03T22:17:41.500Z" level=info msg="Get configmaps 404"
time="2021-06-03T22:17:41.500Z" level=warning msg="Non-transient error: configmaps \"artifact-repositories\" not found"
time="2021-06-03T22:17:41.500Z" level=info msg="resolved artifact repository" artifactRepositoryRef=default-artifact-repository
time="2021-06-03T22:17:41.500Z" level=info msg="Updated phase  -> Running" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:17:41.504Z" level=info msg="Steps node ci-fgfrz initialized Running" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:17:41.504Z" level=info msg="StepGroup node ci-fgfrz-4136101699 initialized Running" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:17:41.505Z" level=info msg="Steps node ci-fgfrz-3128363055 initialized Running" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:17:41.505Z" level=info msg="StepGroup node ci-fgfrz-3240622299 initialized Running" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:17:41.508Z" level=info msg="Create events 201"
time="2021-06-03T22:17:41.510Z" level=info msg="Pod node ci-fgfrz-2248958894 initialized Pending" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:17:41.537Z" level=info msg="Create pods 201"
time="2021-06-03T22:17:41.549Z" level=info msg="Created pod: ci-fgfrz[0].ci[0].git-clone-src (ci-fgfrz-2248958894)" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:17:41.549Z" level=info msg="Workflow step group node ci-fgfrz-3240622299 not yet completed" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:17:41.549Z" level=info msg="Workflow step group node ci-fgfrz-4136101699 not yet completed" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:17:41.576Z" level=info msg="Update workflows 200"
time="2021-06-03T22:17:41.586Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=40427141 workflow=ci-fgfrz
time="2021-06-03T22:17:41.594Z" level=info msg="Create events 201"
time="2021-06-03T22:17:41.604Z" level=info msg="Create events 201"
time="2021-06-03T22:17:41.617Z" level=info msg="Create events 201"
time="2021-06-03T22:17:41.621Z" level=info msg="Create events 201"
time="2021-06-03T22:17:45.216Z" level=info msg="Get leases 200"
time="2021-06-03T22:17:45.222Z" level=info msg="Update leases 200"
time="2021-06-03T22:17:50.225Z" level=info msg="Get leases 200"
time="2021-06-03T22:17:50.231Z" level=info msg="Update leases 200"
time="2021-06-03T22:17:51.547Z" level=info msg="Processing workflow" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:17:51.549Z" level=info msg="Updating node ci-fgfrz-2248958894 message: PodInitializing" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:17:51.551Z" level=info msg="Workflow step group node ci-fgfrz-3240622299 not yet completed" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:17:51.551Z" level=info msg="Workflow step group node ci-fgfrz-4136101699 not yet completed" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:17:51.563Z" level=info msg="Update workflows 200"
time="2021-06-03T22:17:51.564Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=40427214 workflow=ci-fgfrz
time="2021-06-03T22:17:55.234Z" level=info msg="Get leases 200"
time="2021-06-03T22:17:55.240Z" level=info msg="Update leases 200"
time="2021-06-03T22:18:00.244Z" level=info msg="Get leases 200"
time="2021-06-03T22:18:00.251Z" level=info msg="Update leases 200"
time="2021-06-03T22:18:01.567Z" level=info msg="Processing workflow" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:18:01.570Z" level=info msg="Updating node ci-fgfrz-2248958894 status Pending -> Running" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:18:01.572Z" level=info msg="Workflow step group node ci-fgfrz-3240622299 not yet completed" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:18:01.572Z" level=info msg="Workflow step group node ci-fgfrz-4136101699 not yet completed" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:18:01.586Z" level=info msg="Update workflows 200"
time="2021-06-03T22:18:01.588Z" level=info msg="Workflow update successful" namespace=argo phase=Running resourceVersion=40427290 workflow=ci-fgfrz
time="2021-06-03T22:18:01.593Z" level=info msg="Create events 201"
time="2021-06-03T22:18:05.256Z" level=info msg="Get leases 200"
time="2021-06-03T22:18:05.264Z" level=info msg="Update leases 200"
time="2021-06-03T22:18:06.331Z" level=info msg="List workflows 200"
time="2021-06-03T22:18:06.331Z" level=info msg=healthz age=5m0s err="<nil>" instanceID= labelSelector="!workflows.argoproj.io/phase,!workflows.argoproj.io/controller-instanceid" managedNamespace=
time="2021-06-03T22:18:10.267Z" level=info msg="Get leases 200"
time="2021-06-03T22:18:10.274Z" level=info msg="Update leases 200"
time="2021-06-03T22:18:11.590Z" level=info msg="Processing workflow" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:18:11.594Z" level=info msg="Workflow step group node ci-fgfrz-3240622299 not yet completed" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:18:11.594Z" level=info msg="Workflow step group node ci-fgfrz-4136101699 not yet completed" namespace=argo workflow=ci-fgfrz
time="2021-06-03T22:18:11.598Z" level=info msg="cleaning up pod" action=terminateContainers key=argo/ci-fgfrz-2248958894/terminateContainers
time="2021-06-03T22:18:11.599Z" level=info msg="https://10.58.0.1:443/api/v1/namespaces/argo/pods/ci-fgfrz-2248958894/exec?command=%2Fbin%2Fsh&command=-c&command=kill+-s15+--+-1&container=vault-agent&stderr=true&stdout=true&tty=false"
time="2021-06-03T22:18:11.646Z" level=info msg="Create pods/exec 101"
time="2021-06-03T22:18:11.713Z" level=warning msg="failed to clean-up pod" action=terminateContainers error="command terminated with exit code 1" key=argo/ci-fgfrz-2248958894/terminateContainers
time="2021-06-03T22:18:11.713Z" level=warning msg="Non-transient error: command terminated with exit code 1"
time="2021-06-03T22:18:15.282Z" level=info msg="Get leases 200"
time="2021-06-03T22:18:15.291Z" level=info msg="Update leases 200"

@rwong2888
Copy link
Contributor Author

I am also not able to run kaniko as root

---
apiVersion: argoproj.io/v1alpha1
kind: WorkflowTemplate
metadata:
  name: kaniko
spec:
  entrypoint: kaniko
  arguments:
    parameters:
      - name: kaniko-args
         value: ....
  securityContext:
    runAsNonRoot: false
    runAsUser: 0
    runAsGroup: 0
  templates:
    - name: kaniko
      ...

wait time="2021-06-03T22:22:00.420Z" level=info msg="No output parameters"
wait time="2021-06-03T22:22:00.420Z" level=info msg="No output artifacts"
wait time="2021-06-03T22:22:00.420Z" level=info msg="Killing sidecars []"
wait time="2021-06-03T22:22:00.420Z" level=info msg="Alloc=4506 TotalAlloc=8728 Sys=72785 NumGC=3 Goroutines=8"
main Error: error resolving dockerfile path: copying dockerfile: creating file: open /kaniko/Dockerfile: permission denied
main Usage:
main   executor [flags]
main   executor [command]
main Available Commands:
main   help        Help about any command
main   version     Print the version number of kaniko

@alexec
Copy link
Contributor

alexec commented Jun 3, 2021

@rwong2888 what version are you running please?

@rwong2888
Copy link
Contributor Author

rwong2888 commented Jun 3, 2021 •
edited
Loading

argo: v3.1.0-rc10
image: docker.io/argoproj/workflow-controller:v3.1.0-rc10
image: docker.io/argoproj/argocli:v3.1.0-rc10
image: gcr.io/kaniko-project/executor:v1.6.0
image: vault:1.5.4

spec: 
  containers:
    - args:
      - --configmap
      - workflow-controller-configmap
      - --executor-image
      - argoproj/argoexec:dev-signal

data:
  containerRuntimeExecutor: emissary
  executor: |
    imagePullPolicy: Always
  workflowDefaults: |
    spec:
      securityContext:
        runAsNonRoot: true
        runAsUser: 8737

alexec added a commit that referenced this issue Jun 8, 2021
@alexec
fix(executor): Fix emissary kill. Fixes #6030 (#6084)
1533dd4
@alexec alexec mentioned this issue Jun 10, 2021
Closed
20 tasks
@sarabala1979 sarabala1979 mentioned this issue Jun 10, 2021
Closed
88 tasks
alexec added a commit that referenced this issue Jun 10, 2021
@alexec
fix(executor): Fix emissary kill. Fixes #6030 (#6084)
1c27b5f 
Signed-off-by: Alex Collins <alex_collins@intuit.com>
@alexec alexec mentioned this issue Jun 21, 2021
Closed
16 tasks
@alexec alexec mentioned this issue Dec 9, 2021
Closed
@rwong2888 rwong2888 mentioned this issue May 2, 2023
Closed
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@alexec alexec

Labels
type/bug
Projects
None yet
Milestone
v3.1
2 participants
@alexec @rwong2888