Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disabled github auth for dev setup and set up default as development #66 #69

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

AyishikD
Copy link

Disabled github auth for dev setup and set up default as development

Fixes #66
Changed and removed github auth for development in suite.py route, main.py and the services part.
The access_token check is skipped during dev setup.
By default deployment is set to development if not explicitly mentioned

Checklist

@AyishikD
Copy link
Author

@VallariAg can you kindly check the task and merge the pull request.

Copy link
Member

@VallariAg VallariAg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hello @AyishikD, thanks for opening this PR. I've left a few comments.
Additionally, please merge the three commits into one. Also here are the instructions to sign commits: https://docs.github.com/en/authentication/managing-commit-signature-verification/signing-commits

src/teuthology_api/services/kill.py Outdated Show resolved Hide resolved
src/teuthology_api/services/kill.py Outdated Show resolved Hide resolved
src/teuthology_api/routes/suite.py Outdated Show resolved Hide resolved
src/teuthology_api/services/suite.py Outdated Show resolved Hide resolved
src/teuthology_api/services/suite.py Outdated Show resolved Hide resolved
@AyishikD
Copy link
Author

AyishikD commented Sep 10, 2024

@VallariAg kindly check now and regarding the random line changes I pasted the original code from github to remove them but they are still there. Rest changes I have done.

@AyishikD
Copy link
Author

@VallariAg can you kindly recheck and notify me if any changes are needed else merge the changes. Thank you in advance.

Copy link
Member

@VallariAg VallariAg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@AyishikD Hey, to fix the random newlines, you can reset your commit (git reset HEAD~1) and then manually remove the new lines (or undo random removal of blank lines) by checking your changes with git diff.

@AyishikD
Copy link
Author

@VallariAg I completely deleted my commit and added only the required lines still random new lines with @@ are coming . I tried git diff too the more I change the more it increases or remains. I think the new line additions in the middle may have caused it since line numbers are increased. Sorry to say I cannot fix the random new lines cause the more I try more complex they become.

@AyishikD
Copy link
Author

@VallariAg I checked in diffchecker too even the software told me no extra blank lines or less blank lines are present in between the two files except my changed lines.

Copy link
Member

@VallariAg VallariAg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@AyishikD I think you've done a great job removing the random new lines - I only see a couple of them now!
You can try out VS Code: https://code.visualstudio.com/docs/sourcecontrol/overview#_viewing-diffs
It has amazing view of looking at diffs which would help you to only keep the intentional-made changes before making a commit.

I see that your commit message now includes title of all the commits you merged (bunch of repeated lines of sign-offs and "removed github...").
You can change the commit message to be more neat (example: 3798208).
To edit your commit message, you can look up about git commit --amend command.

@AyishikD
Copy link
Author

@VallariAg I have added the extra line gaps through vs code source control where they were previously. I don't think any line blanks are less or more now. Also, I have amended the commit message as you gave in the example. Thank you.

@AyishikD
Copy link
Author

Hii @VallariAg did u check the latest commit?

@AyishikD
Copy link
Author

Hi @VallariAg its been 2 days since I pushed the last commit. Please can you kindly check it?

Copy link
Member

@VallariAg VallariAg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work, it's looking more neater now. I've left a couple more comments. The commit seems to have 1 extra commit title and sign-off, we can probably remove that too.

Also we can revisit the commit description. Example, "- suite.py route: Removed GitHub auth requirement during development." - this is no longer true because we removed this check from routes/suite.py from last iteration of review.

More importantly...
I haven't tested the PR locally yet (and I'll probably only have time to do it later in week). You can test it by sending a request to /suite endpoint to ensure it works after this change. This can be done by using FastAPI Swagger UI (found at /docs endpoint on a browser) and sample payload in README. Please understand that reviews might sometimes take a couple days, especially if there's a weekend. Thanks!

src/teuthology_api/routes/suite.py Outdated Show resolved Hide resolved
src/teuthology_api/main.py Outdated Show resolved Hide resolved
Signed-off-by: AyishikD <99983449+AyishikD@users.noreply.github.com>

Disabled GitHub authentication for the development setup. This change affects the following files:

- `main.py`: Modified to skip the `access_token` check during development.
- `services`: Updated logic to bypass auth checks when in development mode.
@AyishikD
Copy link
Author

@VallariAg I did the changes u mentioned. Tried testing locally where it gave error "ERROR: Could not find a version that satisfies the requirement ansible-core==2.16.6 (from teuthology)"
Then tried testing using codespaces
Route result was"{"root":"success","session":null}"
But in suite its showing
"{
"detail": [
{
"type": "json_invalid",
"loc": [
"body",
0
],
"msg": "JSON decode error",
"input": {},
"ctx": {
"error": "Expecting value"
}
}
]
}"

Some kind of json error I guess
And sorry for disturbing during weekends please don't mind. Actually thought of contributing in ceph in GSOC25, so trying it from now only.

@VallariAg
Copy link
Member

VallariAg commented Sep 18, 2024

@AyishikD I recommend you to try the docker setup to test /suite (it's the easier method) - the instructions are in README.

About the invalid JSON, if you're using the sample payload from README, make sure you have removed the comment starting with // after --teuthology-branch. If it still doesn't work, let me know what your request body looks like. It has to be in valid json format.

@AyishikD
Copy link
Author

@AyishikD I recommend you to try the docker setup to test /suite (it's the easier method) - the instructions are in README.

About the invalid JSON, if you're using the sample payload from README, make sure you have removed the comment starting with // after --teuthology-branch. If it still doesn't work, let me know what your request body looks like. It has to be in valid json format.

While setting up in docker
"ERROR [teuthology 12/14] COPY docs/docker-compose/teuthology/ansible_inventory/hosts /etc/ansible/ 0.0s
=> ERROR [teuthology 13/14] COPY docs/docker-compose/teuthology/ansible_inventory/secrets /etc/ansible/ 0.0s

[teuthology 12/14] COPY docs/docker-compose/teuthology/ansible_inventory/hosts /etc/ansible/:



[teuthology 13/14] COPY docs/docker-compose/teuthology/ansible_inventory/secrets /etc/ansible/:


failed to solve: failed to compute cache key: failed to calculate checksum of ref 1t2jte80wx1pio3pdob9c62e2::4n45y4rahibu92i9mctowph6v: "/docs/docker-compose/teuthology/ansible_inventory/secrets": not found"

This error is coming multiple times.

@VallariAg
Copy link
Member

@AyishikD I have never seen that error before, can you share the steps you took to reach here?

@AyishikD
Copy link
Author

@AyishikD I have never seen that error before, can you share the steps you took to reach here?

Yeah suree
1st I cloned the teuthology repository.
Then I changed its docker file as said in the readme portion.
After that , I started buiding the docker when the error came.
Same error was coming in my virtual environment setup too.
Something with the ansible config file.

@VallariAg
Copy link
Member

@AyishikD It would be more helpful to share commands you ran and their outputs - it's hard to reproduce a problem with vague instructions. But looking at the error you shared before, I think the problem could be that you're supposed to run "./start.sh" in teuthology/docs/docker-compose directory, and you might be running something else to bring the containers up.

See if you're following these steps: https://github.com/ceph/teuthology-api/blob/main/gh-actions/start.sh

@AyishikD
Copy link
Author

@AyishikD It would be more helpful to share commands you ran and their outputs - it's hard to reproduce a problem with vague instructions. But looking at the error you shared before, I think the problem could be that you're supposed to run "./start.sh" in teuthology/docs/docker-compose directory, and you might be running something else to bring the containers up.

See if you're following these steps: https://github.com/ceph/teuthology-api/blob/main/gh-actions/start.sh

Yeah as per instruction I executed the start.sh file
chmod +x start.sh
./start.sh
using this command the whole docker image was generated and all stuffs were unpacked until at the last
"#24 [testnode] exporting to image
#24 exporting layers 25.2s done
#24 CANCELED

[teuthology 5/14] RUN cd /teuthology && mkdir ../archive_dir && mkdir log && chmod +x /teuthology/bootstrap && PIP_INSTALL_FLAGS="-r requirements.txt" ./bootstrap:
2.451 /bin/sh: 1: ./bootstrap: not found


failed to solve: process "/bin/sh -c cd /teuthology && mkdir ../archive_dir && mkdir log && chmod +x /teuthology/bootstrap && PIP_INSTALL_FLAGS="-r requirements.txt" ./bootstrap" did not complete successfully: exit code: 127"

Got this error
Asked chatgpt it gave me reply as
"The error indicates that the script ./bootstrap is missing in the teuthology directory, which causes the Docker build process to fail."

@VallariAg
Copy link
Member

VallariAg commented Sep 20, 2024

@AyishikD it seems to me that you have taken a misstep when setting up the two repos. I think you might be running the command from a wrong directory which is why the "bootstrap" is missing.
Basically the flow is:

git clone https://github.com/ceph/teuthology-api.git
git clone https://github.com/ceph/teuthology.git
echo "  teuthology_api:
        build:
          context: ../../../../
        ports:
            - 8082:8080
        environment: 
            TEUTHOLOGY_API_SERVER_HOST: 0.0.0.0
            TEUTHOLOGY_API_SERVER_PORT: 8080
        depends_on:
            - teuthology
            - paddles
        links:
            - teuthology
            - paddles
        healthcheck:
          test: [ "CMD", "curl", "-f", "http://0.0.0.0:8082" ]
    " >> teuthology/docs/docker-compose/docker-compose.yml
cd teuthology/docs/docker-compose
./start.sh

Can you confirm this is what you did?
If it still doesn't work, try running https://docs.docker.com/reference/cli/docker/system/prune/ before running "start.sh" again.

If it's still not working, share the exact commands you ran and where you ran them and the output, example:

/home $ cd teuthology
/home/teuthology $ ls
<output>

@AyishikD
Copy link
Author

@AyishikD it seems to me that you have taken a misstep when setting up the two repos. I think you might be running the command from a wrong directory which is why the "bootstrap" is missing. Basically the flow is:

git clone https://github.com/ceph/teuthology-api.git
git clone https://github.com/ceph/teuthology.git
echo "  teuthology_api:
        build:
          context: ../../../../
        ports:
            - 8082:8080
        environment: 
            TEUTHOLOGY_API_SERVER_HOST: 0.0.0.0
            TEUTHOLOGY_API_SERVER_PORT: 8080
        depends_on:
            - teuthology
            - paddles
        links:
            - teuthology
            - paddles
        healthcheck:
          test: [ "CMD", "curl", "-f", "http://0.0.0.0:8082" ]
    " >> teuthology/docs/docker-compose/docker-compose.yml
cd teuthology/docs/docker-compose
./start.sh

Can you confirm this is what you did? If it still doesn't work, try running https://docs.docker.com/reference/cli/docker/system/prune/ before running "start.sh" again.

If it's still not working, share the exact commands you ran and where you ran them and the output, example:

/home $ cd teuthology
/home/teuthology $ ls
<output>
git clone https://github.com/ceph/teuthology-api.git
git clone https://github.com/ceph/teuthology.git
echo "  teuthology_api:
        build:
          context: ../../../../
        ports:
            - 8082:8080
        environment:
            TEUTHOLOGY_API_SERVER_HOST: 0.0.0.0
            TEUTHOLOGY_API_SERVER_PORT: 8080
        depends_on:
            - teuthology
            - paddles
        links:
            - teuthology
            - paddles
        healthcheck:
          test: [ \"CMD\", \"curl\", \"-f\", \"http://0.0.0.0:8082\" ]
    " >> teuthology/docs/docker-compose/docker-compose.yml

USER@LAPTOP-55PC613O MINGW64 ~/Desktop
$ cd teuthology/docs/docker-compose

USER@LAPTOP-55PC613O MINGW64 ~/Desktop/teuthology/docs/docker-compose (main)
$ ./start.sh
Generating public/private rsa key pair.
Your identification has been saved in /tmp/teuthology-ssh-key-16VxU4
Your public key has been saved in /tmp/teuthology-ssh-key-16VxU4.pub
The key fingerprint is:
SHA256:pQDNeaMmbN67lmE4lzSqJfDWv4QR4QIagCqSbNMUhew USER@LAPTOP-55PC613O
The key's randomart image is:
+---[RSA 3072]----+
|* ..*+ .         |
|oo = o+ o        |
|+.=.o .o ..      |
|*+ E+.=. o       |
|+o.+.B oS        |
|  + Bo*          |
| . +.=.+         |
|  .  .=          |
|     .oo         |
+----[SHA256]-----+
service volume services.teuthology_api.volumes.[0] is missing a mount target

USER@LAPTOP-55PC613O MINGW64 ~/Desktop/teuthology/docs/docker-compose (main)
$ ./start.sh
Generating public/private rsa key pair.
Your identification has been saved in /tmp/teuthology-ssh-key-SDlBha
Your public key has been saved in /tmp/teuthology-ssh-key-SDlBha.pub
The key fingerprint is:
SHA256:01ozQD6YxbL+yNPr4MKtvgNlfKL7yxJ/jtWXhROLOag USER@LAPTOP-55PC613O
The key's randomart image is:
+---[RSA 3072]----+
|       .o        |
|      .*.        |
|   .  oo+ .      |
|    = o. * +     |
|   + +. S O .    |
|  +  ... = *     |
|   *Eoo+o o      |
|  o.=+*.o.       |
|   +OOooo.       |
+----[SHA256]-----+
#0 building with "desktop-linux" instance using docker driver

#1 [testnode internal] load build definition from Dockerfile
#1 transferring dockerfile: 30B 0.0s
#1 transferring dockerfile: 807B 0.1s done
#1 DONE 0.2s

#2 [beanstalk internal] load build definition from Dockerfile
#2 transferring dockerfile: 359B 0.1s done
#2 DONE 0.2s

#3 [testnode internal] load metadata for docker.io/library/ubuntu:22.04
#3 ...

#4 [testnode auth] library/ubuntu:pull token for registry-1.docker.io
#4 DONE 0.0s

#5 [beanstalk auth] library/alpine:pull token for registry-1.docker.io
#5 DONE 0.0s

#6 [beanstalk internal] load metadata for docker.io/library/alpine:3.12.3
#6 ...

#3 [testnode internal] load metadata for docker.io/library/ubuntu:22.04
#3 DONE 2.6s

#6 [beanstalk internal] load metadata for docker.io/library/alpine:3.12.3
#6 DONE 2.7s

#7 [beanstalk internal] load .dockerignore
#7 transferring context: 2B 0.0s done
#7 DONE 0.1s

#8 [testnode internal] load .dockerignore
#8 transferring context: 2B 0.0s done
#8 DONE 0.1s

#9 [testnode internal] load build context
#9 DONE 0.0s

#10 [beanstalk 1/2] FROM docker.io/library/alpine:3.12.3@sha256:3c7497bf0c7af93428242d6176e8f7905f2201d8fc5861f45be7a346b5f23436
#10 resolve docker.io/library/alpine:3.12.3@sha256:3c7497bf0c7af93428242d6176e8f7905f2201d8fc5861f45be7a346b5f23436 0.1s done
#10 DONE 0.2s

#11 [testnode 1/6] FROM docker.io/library/ubuntu:22.04@sha256:58b87898e82351c6cf9cf5b9f3c20257bb9e2dcf33af051e12ce532d7f94e3fe
#11 resolve docker.io/library/ubuntu:22.04@sha256:58b87898e82351c6cf9cf5b9f3c20257bb9e2dcf33af051e12ce532d7f94e3fe
#11 resolve docker.io/library/ubuntu:22.04@sha256:58b87898e82351c6cf9cf5b9f3c20257bb9e2dcf33af051e12ce532d7f94e3fe 0.1s done
#11 DONE 0.1s

#12 [beanstalk 2/2] RUN apk update && apk add beanstalkd beanstalkd-doc
#12 CACHED

#9 [testnode internal] load build context
#9 transferring context: 110B 0.0s done
#9 DONE 0.0s

#13 [testnode 5/6] COPY testnode_sudoers /etc/sudoers.d/teuthology
#13 CACHED

#14 [testnode 2/6] RUN apt update &&     apt -y install         sudo         openssh-server         hostname         curl         python3-pip         apache2         nfs-kernel-server &&     apt clean all
#14 CACHED

#15 [testnode 4/6] COPY testnode_stop.sh /
#15 CACHED

#16 [testnode 3/6] COPY testnode_start.sh /
#16 CACHED

#17 [testnode 6/6] RUN     ssh-keygen -t dsa -f /etc/ssh/ssh_host_dsa_key -N '' &&     sed -i 's/#PermitRootLogin yes/PermitRootLogin yes/' /etc/ssh/sshd_config &&     mkdir -p /root/.ssh &&     chmod 700 /root/.ssh &&     useradd -g sudo ubuntu &&     mkdir -p /home/ubuntu/.ssh &&     chmod 700 /home/ubuntu/.ssh &&     chown -R ubuntu /home/ubuntu
#17 CACHED

#18 [beanstalk] exporting to image
#18 exporting layers 0.0s done
#18 exporting manifest sha256:795fbcf403b7f5798aae0c8747f8e2249a0c072c51588a513e390018ff011747 0.0s done
#18 exporting config sha256:dd77dcb92f67d9b2dc5bbe4f74d3010578b1cdfb29cedf50f4d94f21befcaea3 0.0s done
#18 exporting attestation manifest sha256:79d37b6733f45e1c682333d454a83d7e9bb2d491a3e9c4d8881ede9dbb8ec1ff
#18 exporting attestation manifest sha256:79d37b6733f45e1c682333d454a83d7e9bb2d491a3e9c4d8881ede9dbb8ec1ff 0.1s done
#18 exporting manifest list sha256:c5a353cc0ad13aa8cc929736117f0749d6c9290b749c2d97089fe2d62f32d022 0.0s done
#18 naming to docker.io/library/docker-compose-beanstalk:latest
#18 naming to docker.io/library/docker-compose-beanstalk:latest 0.0s done
#18 unpacking to docker.io/library/docker-compose-beanstalk:latest 0.0s done
#18 DONE 0.4s

#19 [testnode] exporting to image
#19 ...

#20 [beanstalk] resolving provenance for metadata file
#20 DONE 0.2s

#19 [testnode] exporting to image
#19 ...

#21 [teuthology internal] load build definition from Dockerfile
#21 transferring dockerfile: 1.33kB 0.1s done
#21 DONE 0.1s

#3 [teuthology internal] load metadata for docker.io/library/ubuntu:22.04
#3 DONE 3.4s

#19 [testnode] exporting to image
#19 ...

#11 [teuthology 1/6] FROM docker.io/library/ubuntu:22.04@sha256:58b87898e82351c6cf9cf5b9f3c20257bb9e2dcf33af051e12ce532d7f94e3fe
#11 resolve docker.io/library/ubuntu:22.04@sha256:58b87898e82351c6cf9cf5b9f3c20257bb9e2dcf33af051e12ce532d7f94e3fe 0.1s done
#11 DONE 0.3s

#22 [teuthology internal] load .dockerignore
#22 transferring context: 64B 0.0s done
#22 DONE 0.1s

#23 [teuthology internal] load build context
#23 transferring context: 52.72kB 1.0s done
#23 DONE 1.1s

#24 [teuthology  2/12] RUN apt-get update &&     apt-get install -y     git     qemu-utils     python3-dev     libssl-dev     ipmitool     python3-pip     python3-venv     vim     locales-all     libev-dev     libvirt-dev     libffi-dev     libyaml-dev     locales     lsb-release &&     apt-get clean all &&     locale-gen $LC_ALL
#24 CACHED

#25 [teuthology  3/12] WORKDIR /teuthology
#25 CACHED

#26 [teuthology  4/12] COPY requirements.txt requirements.yml ansible.cfg bootstrap /teuthology/
#26 CACHED

#27 [teuthology  5/12] RUN     cd /teuthology &&     mkdir ../archive_dir &&     mkdir log &&     chmod +x /teuthology/bootstrap &&     PIP_INSTALL_FLAGS="-r requirements.txt" ./bootstrap
#27 5.079 /bin/sh: 1: ./bootstrap: not found
#27 ERROR: process "/bin/sh -c cd /teuthology &&     mkdir ../archive_dir &&     mkdir log &&     chmod +x /teuthology/bootstrap &&     PIP_INSTALL_FLAGS=\"-r requirements.txt\" ./bootstrap" did not complete successfully: exit code: 127

#19 [testnode] exporting to image
#19 exporting layers 10.8s done
#19 CANCELED
------
 > [teuthology  5/12] RUN     cd /teuthology &&     mkdir ../archive_dir &&     mkdir log &&     chmod +x /teuthology/bootstrap &&     PIP_INSTALL_FLAGS="-r requirements.txt" ./bootstrap:
5.079 /bin/sh: 1: ./bootstrap: not found
------
failed to solve: process "/bin/sh -c cd /teuthology &&     mkdir ../archive_dir &&     mkdir log &&     chmod +x /teuthology/bootstrap &&     PIP_INSTALL_FLAGS=\"-r requirements.txt\" ./bootstrap" did not complete successfully: exit code: 127

My docker-compose file in teuthology is like this:

services:
  postgres:
    image: postgres:14
    healthcheck:
      test: [ "CMD", "pg_isready", "-q", "-d", "paddles", "-U", "admin" ]
      timeout: 5s
      interval: 10s
      retries: 2
    environment:
      - POSTGRES_USER=root
      - POSTGRES_PASSWORD=password
      - APP_DB_USER=admin
      - APP_DB_PASS=password
      - APP_DB_NAME=paddles
    volumes:
      - ./db:/docker-entrypoint-initdb.d/
    ports:
      - 5432:5432

  paddles:
    image: quay.io/ceph-infra/paddles
    environment: 
      PADDLES_SERVER_HOST: 0.0.0.0
      PADDLES_SQLALCHEMY_URL: postgresql+psycopg2://admin:password@postgres:5432/paddles
    depends_on:
        postgres:
            condition: service_healthy
    links:
        - postgres
    healthcheck:
        test: ["CMD", "curl", "-f", "http://0.0.0.0:8080"]
        timeout: 5s
        interval: 30s
        retries: 2
    ports: 
        - 8080:8080

  pulpito:
    image: quay.io/ceph-infra/pulpito
    environment:
      PULPITO_PADDLES_ADDRESS: http://paddles:8080
    depends_on:
        paddles:
            condition: service_healthy
    links:
        - paddles
    healthcheck:
        test: ["CMD", "curl", "-f", "http://0.0.0.0:8081"]
        timeout: 5s
        interval: 10s
        retries: 2
    ports:
        - 8081:8081

  beanstalk:
    build: ../../beanstalk/alpine
    ports:
      - "11300:11300"

  teuthology:
    build:
      context: ../../
      dockerfile: ./docs/docker-compose/teuthology/Dockerfile
      args:
        SSH_PRIVKEY_FILE: $SSH_PRIVKEY_FILE
    depends_on:
        paddles:
            condition: service_healthy
    links:
        - paddles
        - beanstalk
    environment:
      SSH_PRIVKEY:
      SSH_PRIVKEY_FILE:
      MACHINE_TYPE:
      TESTNODES:
      TEUTHOLOGY_WAIT:
      TEUTH_BRANCH:

  testnode:
    build:
      context: ./testnode
      dockerfile: ./Dockerfile
    deploy:
      replicas: 3
    depends_on:
        paddles:
            condition: service_healthy
    links:
      - paddles
    ports:
      - "22"
    environment:
      SSH_PUBKEY:
    platform: linux/amd64

  teuthology_api:
    build:
      context: ../../../teuthology-api
    env_file: ../../../teuthology-api/.env
    ports:
      - 8082:8080
    environment:
      TEUTHOLOGY_API_SERVER_HOST: 0.0.0.0
      TEUTHOLOGY_API_SERVER_PORT: 8080
      PADDLES_URL: http://localhost:8080
      DEPLOYMENT: development
    depends_on:
      - teuthology
      - paddles
    links:
      - teuthology
      - paddles
    healthcheck:
      test: [ "CMD", "curl", "-f", "http://0.0.0.0:8082" ]
    volumes:
      - ../../../teuthology-api/src:/teuthology_api/src:rw

@VallariAg
Copy link
Member

@AyishikD Everything looks correct to me, that's great. I see there's some cached layers, can you try https://docs.docker.com/reference/cli/docker/system/prune/ and then rerun start.sh and see if that works?

@AyishikD
Copy link
Author

[teuthology 5/12] RUN cd /teuthology && mkdir ../archive_dir && mkdir log && chmod +x /teuthology/bootstrap && PIP_INSTALL_FLAGS="-r requirements.txt" ./bootstrap:
2.877 /bin/sh: 1: ./bootstrap: not found


failed to solve: process "/bin/sh -c cd /teuthology && mkdir ../archive_dir && mkdir log && chmod +x /teuthology/bootstrap && PIP_INSTALL_FLAGS="-r requirements.txt" ./bootstrap" did not complete successfully: exit code: 127

same error is coming after running

 docker system prune
WARNING! This will remove:
  - all stopped containers
  - all networks not used by at least one container
  - all dangling images
  - unused build cache

Are you sure you want to continue? [y/N] y
Deleted Containers:
628f711b4af147aa473dc61261ba2976a359cc24c44adb83ed0b7e1c0b4240bd
8396614a904adbbbbf17e09f400febef22b179619bc2fdf4ee5f855348a60299
c3b4ecce12b1f1b4395dd4a31447258818abc2997d699142ee08a16cb43b75e6
0bc55fe8687b403b6f49991827731b207ee69359f77c1da0319aa3d071dfe98c
7c96eb2c903eee9111e7fba1767f2096273b62664f7b6ebe7ad1adb827ca7759
40229a927e1004089622193624f23f6284a24488267c746d7f38362d125c688e
483834e9bdc4f100010bb857e2878c96d378c8617d1897ce09d0a41471787ae3
2c523e2be91477a14fc47baa699b3aec1010e2d46b1fc8935acf8742df48feac
4228ed9ec1818455dc7494509190ee31109b8c0fed9630c75077a7d49347e3b2
4464226323e6a411b9cbd95464b7114c7f0cf36f28bf7055440545246848e42d
089ee169f2dcf9a9a9246e20334b426bbe48041ec0c667e6a05b9550ef2b0369
c8ae96bd491a3e2ba3e6d046dd59bbf72730530f8603d076e048aca5eb6be462
9e9fee3a479e22ec71ba2d30b5d51569275564eeb4723b8575fad8663f5d5349
9fc069e1729a657c6177badef48bbc153ede02f1beb08e32f1aaf700525344ce
068eb0ceb3266fdb0db221e73295e7f4d189ab284393b38d9dd31026e6cb6b9a
4019ea0c0e3ba2bf8530b9252b7a56da38c77b0e23717939ae8019b3cddfa941
6e12f72687acb9ef3083eb5fc807248515374cf7a2370222a6b1bf6c2ee65a4e
b3ca104fa7839c9e64dce825b3b8d478ee463b5b7e419ae7ea6adff8673eeeee

Deleted Networks:
jenkins

Deleted build cache objects:
vv53ycht6twkikj0r4829b3kh
kn9ftc89lzbg4uecwqlprjqaz
x41rl5t18vozhwefo2dzpnakd
zohs7ksmbnzkinejot5rem2ov
k0h6uvdr5wr6dvy6lf610d2jr
kjk0othdgzrw9bmejsxh2e0ms
bowqicl5zy6rtoojju0z5nxkx
r5guk1l3h5633zermthuljina
uju5j2zfs9wknicjgfekpcfn9
4krcdi9g2gjvh0bnb7q28ry1l
p82h6mda6b9ivn8bw95wbr1hk
cnvn54cpf9vattgkfdtfrqzpt
qyawt20eid7yahnr4j3unjfjk
ivsfj5mbvc5xs354poatx0eub
ncbys8qvub1k4g3tub72jsxh7
sq78qg16s25rc5rrbblhx6taj
yjh9dxop9f4fb9g56yflw146t
5b86f3mj7aed9zthmgc6t9eni
fjmcne3iq7pcqdwdcanwak0e5
chebjqxhdwf0uz72hd5urvb56
clily8fl47xfa7k3wtyx3matw
de7xzfjewca3ewdem143le7vz
5aat99paf651c92svsl60ypq1
b98baiefs90lxqs2l64cam0hp
r8glpvxaqufct1qw3i13lamk8
ahubd0f6gap0jie7v9oknx63e
mvwqu24rml40qcrdxj9pinlw3
n2gyry96tvab1lnskcx7p4dax
z0fl58s0v28ybhzehyj1opxol
pkogecybmg63dmn8m33d0ya60
igtv7kpeth2bg7futlii0ltxb
0kegc6kbdyraw3ts4c1rrytlr
kgogqc0kbpxv6534sce401k24
7lookyg16m1cgvxirsdtq9wa1
b1tw7a7q2q0eilnam418mgcp3
saz4nkaym40d1naa3fyex78zd
1bo3btgeoipebwc6nyb7vvwtf
8ovaiqia6ldfjlgk9ft3z32x0

Total reclaimed space: 3.453GB

USER@LAPTOP-55PC613O MINGW64 ~/Desktop/teuthology/docs/docker-compose (main)
$ docker system prune -a --volumes
WARNING! This will remove:
  - all stopped containers
  - all networks not used by at least one container
  - all anonymous volumes not used by at least one container
  - all images without at least one container associated to them
  - all build cache

Are you sure you want to continue? [y/N] y
Deleted Containers:
ca5fa49cfc610875e18805f4818cd15c37010ae50850334420d84de60bebafbb

Deleted Images:
untagged: jenkins/jenkins:latest
deleted: sha256:078194d3c9a9255a78eb6ee016c7e2f4b087eb152d3ac778e4d9e128ee934fac
deleted: sha256:04f29f3d6afdcf0e3a5fc627d21747547e1818c79d6ae6317598536bbeb4dd74
deleted: sha256:f21bb75b933ff32cdf7a8f1b606edc58cdf37fd9335374b7d1063fce67e885b3
deleted: sha256:8cd46d290033f265db57fd808ac81c444ec5a5b3f189c3d6d85043b647336913
deleted: sha256:6d4074d3076c30acde51beb4dba21c41a554181bfdd67779c1afe8eab582d676
deleted: sha256:8b2efcb3042de6abb524922496b422c0a3d0835e9e71371859b9de01789f578c
deleted: sha256:f112150656b7180e370bd61c597b0260b0a15453c35b363211a4c7ffb55c1e12
deleted: sha256:eb92bd75786ae440749c4c6e33c5da673eaa7962ced2cb5a715de0c5151765e4
deleted: sha256:1038356bd42320ba961d6c130ad2dad2350215cd4206d5b1c55bb18d9633e56c
deleted: sha256:7d0dfff8c2ebf3d0436acdc778b3c8fc0dd3a9bd4c4ce3baaec931a642ab2168
deleted: sha256:710dcac21e531bbc8f9ae01f814692b0d67a7cc9af4c1c21f20a88d5d0c2c3d6
deleted: sha256:5c9f94a0f6d62a16249247dc8f6491bd741892f11d1d4e152c0b7c52c4cf3388
deleted: sha256:197ea3ebd22668aef829171323bc3568a80cf7af4943c09329d161ee8dd6437b
deleted: sha256:b920d516b373353e4eb53350287713b1e753293daed45fed9dce0f80ea4e57df
deleted: sha256:5c6f14144ee3d8e7232bd26bb3e4befcf50a1c7d0f497cc96f50401b374dbf8e
untagged: registry.k8s.io/etcd:3.5.12-0
untagged: docker/desktop-kubernetes:kubernetes-v1.30.2-cni-v1.4.0-critools-v1.29.0-cri-dockerd-v0.3.11-1-debian
deleted: sha256:c86a2c3962729d12e51fbb4c8feeefea67778a70a6ffecf3baff3039d80b4cf5
deleted: sha256:63d53397a851b0235a178731d598c6ca93122fcef7da4fef57ef48615230c289
deleted: sha256:8b7b9de36bd5f5336bb67cdb6d8e69f9d51cf493f7ab119804aab5fbf2ad5476
deleted: sha256:c5e7c42b8a5d5d12f284c633cddec95181866df35b590595b22423d8dcbd7292
deleted: sha256:46dd3871952e9136a76cf4288c333a4470ae74cbe4d869964ecc851648ec457e
deleted: sha256:42cd6f42c52bdeaae6b4042fc2d7ee0507a9e621abdf960e0b288f5e512d84eb
deleted: sha256:d9e1d5c59d7cdd50f3b8e7456be967cbafb4483088bf5131c2517c5767b52740
untagged: registry.k8s.io/kube-proxy:v1.30.2
untagged: devopsjourney1/jenkins-blueocean:2.332.3-1
untagged: docker-compose-beanstalk:latest
deleted: sha256:c5a353cc0ad13aa8cc929736117f0749d6c9290b749c2d97089fe2d62f32d022
deleted: sha256:795fbcf403b7f5798aae0c8747f8e2249a0c072c51588a513e390018ff011747
deleted: sha256:dd77dcb92f67d9b2dc5bbe4f74d3010578b1cdfb29cedf50f4d94f21befcaea3
deleted: sha256:79d37b6733f45e1c682333d454a83d7e9bb2d491a3e9c4d8881ede9dbb8ec1ff
deleted: sha256:696fbc62e09510808198d58b2619b68cfe572187255fcf97f8523bb9da399251
deleted: sha256:03fb280d03b4a42f6c5fb03b63ffb5beade45ef87447268c99be16aabcdde27e
untagged: postgres:14
deleted: sha256:1bd26d434ac67d210a42cf19fa0812efd22472e0494f9c6ffa654509f427608a
deleted: sha256:7e5ab07bd2c945295aed3403d9d9b3ede13c7c612c98b86b0a394fe150016235
deleted: sha256:480f26a07aa1d15232d044a3a67dcddd0af1cd5fda93249ff530915c02e1488f
deleted: sha256:a2318d6c47ec9cac5acc500c47c79602bcf953cec711a18bc898911a0984365b
deleted: sha256:3daeaad395c0c6e7a6372f3490a6845a05cc5583286233feb1a6324d74b10fef
deleted: sha256:2fbd795be6ff97362147f006741036fb375edefd277561e0819c4df9a22dfe92
deleted: sha256:ccd768ecd575d838164d2d243460bf06f4cd3803b05fce0eb806ac41b86fa4e4
deleted: sha256:b059c433f63aa241abd707f8a449fad750d7cfe6fd1184c1c25b1630423b6574
deleted: sha256:a5b9a0b481a7300525980b8c37e5e375014321ebd6c11345e17374ef47827c2c
deleted: sha256:705e3fb3821e2f3eba41c0eee89f392a0cf05f32cc6916bccdabe5820d633ad2
deleted: sha256:51ddd42dd76f8bc1bb35ef376e1a2883ab382142b046432e99f5a705feae12fc
deleted: sha256:904d7dd762e981508e458de7fc429da42afa662a3406acef7d66eae87a7082fe
deleted: sha256:93d7dbd4aa6345bda1d6b6d729a4de639cfa8f8870513c0e821623757542441f
deleted: sha256:d0084d6124b9fa3e200eb4a008aa4c67a0526c98e7bbedef8ef35ef15be7ad39
deleted: sha256:dc99a23b7a41d1aed98da3b97956c3aef4fdf284aba4551035cbc6ecdc0af72b
deleted: sha256:72479dca224ab54aa3132175744e710b5f0586269628503de714cc61a9982f1a
deleted: sha256:1fc20e341857397af1cbc463f2dd56707906f45adc4e37f5779dcda67aa0bbac
untagged: quay.io/ceph-infra/paddles:latest
deleted: sha256:bb9cd5ab7566c76effa24d237ee985ab4c9b20e2c22fc27d85de0d90fd62a58f
deleted: sha256:82fafde4b0df3cf9c20dc1f309de7c259c35fa36c3daabb7a43754e796306a53
deleted: sha256:c6a83fedfae6ed8a4f5f7cbb6a7b6f1c1ec3d86fea8cb9e5ba2e5e6673fde9f6
deleted: sha256:b9dc4119f2ec8172c585e3a6b9dd1dead61612cab2ebab820703fd122a07129b
deleted: sha256:545d94f91829cfc9031a9578cf5a2238f285cc0f2e04203dd32613f2a55cfeb6
deleted: sha256:4271f5ef1d3946e791b3cf6b9748767d9c8a5a299fc0ddc3d0dffcc2bec5b52c
deleted: sha256:780f71a8607261eb6b1fea0f26d806767a3730696c0ff0a99ca4fad403c01839
deleted: sha256:757b9ccf5fac75813c8d142804e72895134018c71ed449da94c30ae76385edeb
deleted: sha256:ff807d2e43bedba58001c1d80e619aa4d3c0204b703876daccc28258c01d0a3a
deleted: sha256:b6c022a2d4128d07305ff9c0baafffea08069a5140ee2282195f582a8c373ea0
deleted: sha256:bf9b5dab5ed66cc494202c4bd352bc662c730afebe211d7b6ac8eba8654478a9
deleted: sha256:058b1ba88d53461fe18873a8f637799b4adaf1d5a278c100b5382b6e8b5cecae
deleted: sha256:f01cf01d4e4f8b789cd56aa24ca82c2487b0c5e07afba88e0af5865bbd89d914
deleted: sha256:2874c2e9b4482a444583d809f140a5e27dde6182f50f670a54346b3749d6a6c3
deleted: sha256:0e7dc2eb8667192d07127b8cceb64c4392432f5afc4b74871e70255bb6c1eb07
untagged: quay.io/ceph-infra/pulpito:latest
deleted: sha256:3de59b5ca93c7e869cbf123dd073ac776cfb64945696c28ea795745f9050259b
deleted: sha256:63729dacea7548ed4eaef2b24a0dd2eabf6430d1fc408cffa4e830862571c83d
deleted: sha256:96526aa774ef0126ad0fe9e9a95764c5fc37f409ab9e97021e7b4775d82bf6fa
deleted: sha256:9875af95546db78168a6761b7fa205ed1cd0c153cd89356c1512e551c12b2d5c
deleted: sha256:4819c95424fc4a94767c9329b02238ebcce0bc682384cb671379bc1fb8a12b55
deleted: sha256:148762f75a1f92cc9857e9c488bf95d5aac61e9905ec47a7408025b2dd5c3b7a
deleted: sha256:ea1518237b3753b3fe40ee773d77651704178d9baa72ae5012e13a992cfa6c63
deleted: sha256:30c8e0c2d09693d5a181bebb3323bdcee7f0e61d8498c4c31f5c0ce3415034f6
deleted: sha256:fdd190e8c1e5eec35ecafba1502cbfaad1597110bbd18d231544b2e8375fe8b0
deleted: sha256:a9ebb35b718184701abeb18b684f30a0b63575dc65b626eaccafc22587c597db
deleted: sha256:24bf11acbd3221a5a9eef28ebffc927c8666bfcfeee33013c03a5cdd95ac629e
deleted: sha256:aae3ba9e0927d290df42dfbdb76d158c684d40e7e9cb364a033205153e8e00df
deleted: sha256:5cb921b6c221269608e65c6698154c83236be7b75ee6bd9786d0fdeff4011d56
untagged: registry.k8s.io/kube-scheduler:v1.30.2
untagged: docker/desktop-storage-provisioner:v2.0
untagged: docker/desktop-vpnkit-controller:dc331cb22850be0cdd97c84a9cfecaf44a1afb6e
untagged: myjenkins-blueocean:2.332.3-1
deleted: sha256:f414ed9f6cd2b60ae5867324700c2a45e27264fdd35abddee38ae16899dc9d0f
deleted: sha256:f0cea31942b5573e09ef6341e2b393ca17e9b4e1dc6e91d3d3979e104f653000
deleted: sha256:1339eaac5b67d16d6d9f41fb7a7b96f7cebf3ba4beab36cbb60935aa772af583
deleted: sha256:ee7fe1de523477eca2eb90fe79bed0deebd6d31c705127e1d9cdd4cc4c1397b4
deleted: sha256:a167e5ee9d3d3ffd6cde558495dba214573df628c6ca12eec6a60f3b6ca5c527
deleted: sha256:635f2040c45de6fbf42620356288b5d627a377fa8bd6ff9fe35187657ec6051d
deleted: sha256:0de24a2d2be853abdcd06832a09e57d7678175268d93f94feee70a7d0b3977a0
deleted: sha256:523f7f5f5298bb07c6110e61de11cb6b50895c533152931ea83a9037934eac23
deleted: sha256:0417692c0dbbb11b57c6287addd8d86f81829bb4353678e9c8728aa0dc99460d
deleted: sha256:8ad508db83b2bc8f75d959d645822d0c7510d9e66db5a5b9c0c29bc8b3dbfe34
deleted: sha256:91d64a25931af66d77a9c7627661742b174881dd87e3ba0e2b07fd2109c93677
deleted: sha256:6432ac88896af5f44091e20c7c8d4c4636ca3f8920bcd35f56abdf31b4f060c1
deleted: sha256:427fea71d52896f96dda6aa0ce682689329632c6f043331b79e11b847516f0de
deleted: sha256:8b9f06c8766130cb2a99038d76ee6b7feb3bfec905771272e807cb97acacfe75
deleted: sha256:7145f515d9228af08c45d387eac4fd0cb448acb106c927cc4d3b673973ed681f
deleted: sha256:97599d4b06aa37ca6727f9ef562a3ddcc90f3ea6022649f90369c62ac70dd10a
deleted: sha256:c0de4b3e376cf35f8d50cd74a0b9e523669624379ee94df23cdff4572eab4c46
deleted: sha256:253de6ee3d92989ac98af9c53bf43fc3e891d7361e7cfd3b638608bbd8e32d1d
deleted: sha256:fcc3b5be0cfb2056bd2d8235e93b27c5d4c56067584dfa81d951d2fba5a1e7fc
deleted: sha256:638c2322f09a298fec314a55c450781d9c9de5a7fa23134dcf462c0ef44f41b3
deleted: sha256:e90424c20795504fe8f9099880d512c00d4df26b6d506a508f13f033deceb46d
untagged: registry.k8s.io/coredns/coredns:v1.11.1
untagged: registry.k8s.io/kube-apiserver:v1.30.2
untagged: registry.k8s.io/kube-controller-manager:v1.30.2

Deleted build cache objects:
k1qm37h28cxea9s9712f3ba73
rdjvr3g6eswb5n8d9qiepkzw1

Total reclaimed space: 1.26GB

@AyishikD
Copy link
Author

[teuthology 5/12] RUN cd /teuthology && mkdir ../archive_dir && mkdir log && chmod +x /teuthology/bootstrap && PIP_INSTALL_FLAGS="-r requirements.txt" ./bootstrap:
2.877 /bin/sh: 1: ./bootstrap: not found

failed to solve: process "/bin/sh -c cd /teuthology && mkdir ../archive_dir && mkdir log && chmod +x /teuthology/bootstrap && PIP_INSTALL_FLAGS="-r requirements.txt" ./bootstrap" did not complete successfully: exit code: 127

same error is coming after running

 docker system prune
WARNING! This will remove:
  - all stopped containers
  - all networks not used by at least one container
  - all dangling images
  - unused build cache

Are you sure you want to continue? [y/N] y
Deleted Containers:
628f711b4af147aa473dc61261ba2976a359cc24c44adb83ed0b7e1c0b4240bd
8396614a904adbbbbf17e09f400febef22b179619bc2fdf4ee5f855348a60299
c3b4ecce12b1f1b4395dd4a31447258818abc2997d699142ee08a16cb43b75e6
0bc55fe8687b403b6f49991827731b207ee69359f77c1da0319aa3d071dfe98c
7c96eb2c903eee9111e7fba1767f2096273b62664f7b6ebe7ad1adb827ca7759
40229a927e1004089622193624f23f6284a24488267c746d7f38362d125c688e
483834e9bdc4f100010bb857e2878c96d378c8617d1897ce09d0a41471787ae3
2c523e2be91477a14fc47baa699b3aec1010e2d46b1fc8935acf8742df48feac
4228ed9ec1818455dc7494509190ee31109b8c0fed9630c75077a7d49347e3b2
4464226323e6a411b9cbd95464b7114c7f0cf36f28bf7055440545246848e42d
089ee169f2dcf9a9a9246e20334b426bbe48041ec0c667e6a05b9550ef2b0369
c8ae96bd491a3e2ba3e6d046dd59bbf72730530f8603d076e048aca5eb6be462
9e9fee3a479e22ec71ba2d30b5d51569275564eeb4723b8575fad8663f5d5349
9fc069e1729a657c6177badef48bbc153ede02f1beb08e32f1aaf700525344ce
068eb0ceb3266fdb0db221e73295e7f4d189ab284393b38d9dd31026e6cb6b9a
4019ea0c0e3ba2bf8530b9252b7a56da38c77b0e23717939ae8019b3cddfa941
6e12f72687acb9ef3083eb5fc807248515374cf7a2370222a6b1bf6c2ee65a4e
b3ca104fa7839c9e64dce825b3b8d478ee463b5b7e419ae7ea6adff8673eeeee

Deleted Networks:
jenkins

Deleted build cache objects:
vv53ycht6twkikj0r4829b3kh
kn9ftc89lzbg4uecwqlprjqaz
x41rl5t18vozhwefo2dzpnakd
zohs7ksmbnzkinejot5rem2ov
k0h6uvdr5wr6dvy6lf610d2jr
kjk0othdgzrw9bmejsxh2e0ms
bowqicl5zy6rtoojju0z5nxkx
r5guk1l3h5633zermthuljina
uju5j2zfs9wknicjgfekpcfn9
4krcdi9g2gjvh0bnb7q28ry1l
p82h6mda6b9ivn8bw95wbr1hk
cnvn54cpf9vattgkfdtfrqzpt
qyawt20eid7yahnr4j3unjfjk
ivsfj5mbvc5xs354poatx0eub
ncbys8qvub1k4g3tub72jsxh7
sq78qg16s25rc5rrbblhx6taj
yjh9dxop9f4fb9g56yflw146t
5b86f3mj7aed9zthmgc6t9eni
fjmcne3iq7pcqdwdcanwak0e5
chebjqxhdwf0uz72hd5urvb56
clily8fl47xfa7k3wtyx3matw
de7xzfjewca3ewdem143le7vz
5aat99paf651c92svsl60ypq1
b98baiefs90lxqs2l64cam0hp
r8glpvxaqufct1qw3i13lamk8
ahubd0f6gap0jie7v9oknx63e
mvwqu24rml40qcrdxj9pinlw3
n2gyry96tvab1lnskcx7p4dax
z0fl58s0v28ybhzehyj1opxol
pkogecybmg63dmn8m33d0ya60
igtv7kpeth2bg7futlii0ltxb
0kegc6kbdyraw3ts4c1rrytlr
kgogqc0kbpxv6534sce401k24
7lookyg16m1cgvxirsdtq9wa1
b1tw7a7q2q0eilnam418mgcp3
saz4nkaym40d1naa3fyex78zd
1bo3btgeoipebwc6nyb7vvwtf
8ovaiqia6ldfjlgk9ft3z32x0

Total reclaimed space: 3.453GB

USER@LAPTOP-55PC613O MINGW64 ~/Desktop/teuthology/docs/docker-compose (main)
$ docker system prune -a --volumes
WARNING! This will remove:
  - all stopped containers
  - all networks not used by at least one container
  - all anonymous volumes not used by at least one container
  - all images without at least one container associated to them
  - all build cache

Are you sure you want to continue? [y/N] y
Deleted Containers:
ca5fa49cfc610875e18805f4818cd15c37010ae50850334420d84de60bebafbb

Deleted Images:
untagged: jenkins/jenkins:latest
deleted: sha256:078194d3c9a9255a78eb6ee016c7e2f4b087eb152d3ac778e4d9e128ee934fac
deleted: sha256:04f29f3d6afdcf0e3a5fc627d21747547e1818c79d6ae6317598536bbeb4dd74
deleted: sha256:f21bb75b933ff32cdf7a8f1b606edc58cdf37fd9335374b7d1063fce67e885b3
deleted: sha256:8cd46d290033f265db57fd808ac81c444ec5a5b3f189c3d6d85043b647336913
deleted: sha256:6d4074d3076c30acde51beb4dba21c41a554181bfdd67779c1afe8eab582d676
deleted: sha256:8b2efcb3042de6abb524922496b422c0a3d0835e9e71371859b9de01789f578c
deleted: sha256:f112150656b7180e370bd61c597b0260b0a15453c35b363211a4c7ffb55c1e12
deleted: sha256:eb92bd75786ae440749c4c6e33c5da673eaa7962ced2cb5a715de0c5151765e4
deleted: sha256:1038356bd42320ba961d6c130ad2dad2350215cd4206d5b1c55bb18d9633e56c
deleted: sha256:7d0dfff8c2ebf3d0436acdc778b3c8fc0dd3a9bd4c4ce3baaec931a642ab2168
deleted: sha256:710dcac21e531bbc8f9ae01f814692b0d67a7cc9af4c1c21f20a88d5d0c2c3d6
deleted: sha256:5c9f94a0f6d62a16249247dc8f6491bd741892f11d1d4e152c0b7c52c4cf3388
deleted: sha256:197ea3ebd22668aef829171323bc3568a80cf7af4943c09329d161ee8dd6437b
deleted: sha256:b920d516b373353e4eb53350287713b1e753293daed45fed9dce0f80ea4e57df
deleted: sha256:5c6f14144ee3d8e7232bd26bb3e4befcf50a1c7d0f497cc96f50401b374dbf8e
untagged: registry.k8s.io/etcd:3.5.12-0
untagged: docker/desktop-kubernetes:kubernetes-v1.30.2-cni-v1.4.0-critools-v1.29.0-cri-dockerd-v0.3.11-1-debian
deleted: sha256:c86a2c3962729d12e51fbb4c8feeefea67778a70a6ffecf3baff3039d80b4cf5
deleted: sha256:63d53397a851b0235a178731d598c6ca93122fcef7da4fef57ef48615230c289
deleted: sha256:8b7b9de36bd5f5336bb67cdb6d8e69f9d51cf493f7ab119804aab5fbf2ad5476
deleted: sha256:c5e7c42b8a5d5d12f284c633cddec95181866df35b590595b22423d8dcbd7292
deleted: sha256:46dd3871952e9136a76cf4288c333a4470ae74cbe4d869964ecc851648ec457e
deleted: sha256:42cd6f42c52bdeaae6b4042fc2d7ee0507a9e621abdf960e0b288f5e512d84eb
deleted: sha256:d9e1d5c59d7cdd50f3b8e7456be967cbafb4483088bf5131c2517c5767b52740
untagged: registry.k8s.io/kube-proxy:v1.30.2
untagged: devopsjourney1/jenkins-blueocean:2.332.3-1
untagged: docker-compose-beanstalk:latest
deleted: sha256:c5a353cc0ad13aa8cc929736117f0749d6c9290b749c2d97089fe2d62f32d022
deleted: sha256:795fbcf403b7f5798aae0c8747f8e2249a0c072c51588a513e390018ff011747
deleted: sha256:dd77dcb92f67d9b2dc5bbe4f74d3010578b1cdfb29cedf50f4d94f21befcaea3
deleted: sha256:79d37b6733f45e1c682333d454a83d7e9bb2d491a3e9c4d8881ede9dbb8ec1ff
deleted: sha256:696fbc62e09510808198d58b2619b68cfe572187255fcf97f8523bb9da399251
deleted: sha256:03fb280d03b4a42f6c5fb03b63ffb5beade45ef87447268c99be16aabcdde27e
untagged: postgres:14
deleted: sha256:1bd26d434ac67d210a42cf19fa0812efd22472e0494f9c6ffa654509f427608a
deleted: sha256:7e5ab07bd2c945295aed3403d9d9b3ede13c7c612c98b86b0a394fe150016235
deleted: sha256:480f26a07aa1d15232d044a3a67dcddd0af1cd5fda93249ff530915c02e1488f
deleted: sha256:a2318d6c47ec9cac5acc500c47c79602bcf953cec711a18bc898911a0984365b
deleted: sha256:3daeaad395c0c6e7a6372f3490a6845a05cc5583286233feb1a6324d74b10fef
deleted: sha256:2fbd795be6ff97362147f006741036fb375edefd277561e0819c4df9a22dfe92
deleted: sha256:ccd768ecd575d838164d2d243460bf06f4cd3803b05fce0eb806ac41b86fa4e4
deleted: sha256:b059c433f63aa241abd707f8a449fad750d7cfe6fd1184c1c25b1630423b6574
deleted: sha256:a5b9a0b481a7300525980b8c37e5e375014321ebd6c11345e17374ef47827c2c
deleted: sha256:705e3fb3821e2f3eba41c0eee89f392a0cf05f32cc6916bccdabe5820d633ad2
deleted: sha256:51ddd42dd76f8bc1bb35ef376e1a2883ab382142b046432e99f5a705feae12fc
deleted: sha256:904d7dd762e981508e458de7fc429da42afa662a3406acef7d66eae87a7082fe
deleted: sha256:93d7dbd4aa6345bda1d6b6d729a4de639cfa8f8870513c0e821623757542441f
deleted: sha256:d0084d6124b9fa3e200eb4a008aa4c67a0526c98e7bbedef8ef35ef15be7ad39
deleted: sha256:dc99a23b7a41d1aed98da3b97956c3aef4fdf284aba4551035cbc6ecdc0af72b
deleted: sha256:72479dca224ab54aa3132175744e710b5f0586269628503de714cc61a9982f1a
deleted: sha256:1fc20e341857397af1cbc463f2dd56707906f45adc4e37f5779dcda67aa0bbac
untagged: quay.io/ceph-infra/paddles:latest
deleted: sha256:bb9cd5ab7566c76effa24d237ee985ab4c9b20e2c22fc27d85de0d90fd62a58f
deleted: sha256:82fafde4b0df3cf9c20dc1f309de7c259c35fa36c3daabb7a43754e796306a53
deleted: sha256:c6a83fedfae6ed8a4f5f7cbb6a7b6f1c1ec3d86fea8cb9e5ba2e5e6673fde9f6
deleted: sha256:b9dc4119f2ec8172c585e3a6b9dd1dead61612cab2ebab820703fd122a07129b
deleted: sha256:545d94f91829cfc9031a9578cf5a2238f285cc0f2e04203dd32613f2a55cfeb6
deleted: sha256:4271f5ef1d3946e791b3cf6b9748767d9c8a5a299fc0ddc3d0dffcc2bec5b52c
deleted: sha256:780f71a8607261eb6b1fea0f26d806767a3730696c0ff0a99ca4fad403c01839
deleted: sha256:757b9ccf5fac75813c8d142804e72895134018c71ed449da94c30ae76385edeb
deleted: sha256:ff807d2e43bedba58001c1d80e619aa4d3c0204b703876daccc28258c01d0a3a
deleted: sha256:b6c022a2d4128d07305ff9c0baafffea08069a5140ee2282195f582a8c373ea0
deleted: sha256:bf9b5dab5ed66cc494202c4bd352bc662c730afebe211d7b6ac8eba8654478a9
deleted: sha256:058b1ba88d53461fe18873a8f637799b4adaf1d5a278c100b5382b6e8b5cecae
deleted: sha256:f01cf01d4e4f8b789cd56aa24ca82c2487b0c5e07afba88e0af5865bbd89d914
deleted: sha256:2874c2e9b4482a444583d809f140a5e27dde6182f50f670a54346b3749d6a6c3
deleted: sha256:0e7dc2eb8667192d07127b8cceb64c4392432f5afc4b74871e70255bb6c1eb07
untagged: quay.io/ceph-infra/pulpito:latest
deleted: sha256:3de59b5ca93c7e869cbf123dd073ac776cfb64945696c28ea795745f9050259b
deleted: sha256:63729dacea7548ed4eaef2b24a0dd2eabf6430d1fc408cffa4e830862571c83d
deleted: sha256:96526aa774ef0126ad0fe9e9a95764c5fc37f409ab9e97021e7b4775d82bf6fa
deleted: sha256:9875af95546db78168a6761b7fa205ed1cd0c153cd89356c1512e551c12b2d5c
deleted: sha256:4819c95424fc4a94767c9329b02238ebcce0bc682384cb671379bc1fb8a12b55
deleted: sha256:148762f75a1f92cc9857e9c488bf95d5aac61e9905ec47a7408025b2dd5c3b7a
deleted: sha256:ea1518237b3753b3fe40ee773d77651704178d9baa72ae5012e13a992cfa6c63
deleted: sha256:30c8e0c2d09693d5a181bebb3323bdcee7f0e61d8498c4c31f5c0ce3415034f6
deleted: sha256:fdd190e8c1e5eec35ecafba1502cbfaad1597110bbd18d231544b2e8375fe8b0
deleted: sha256:a9ebb35b718184701abeb18b684f30a0b63575dc65b626eaccafc22587c597db
deleted: sha256:24bf11acbd3221a5a9eef28ebffc927c8666bfcfeee33013c03a5cdd95ac629e
deleted: sha256:aae3ba9e0927d290df42dfbdb76d158c684d40e7e9cb364a033205153e8e00df
deleted: sha256:5cb921b6c221269608e65c6698154c83236be7b75ee6bd9786d0fdeff4011d56
untagged: registry.k8s.io/kube-scheduler:v1.30.2
untagged: docker/desktop-storage-provisioner:v2.0
untagged: docker/desktop-vpnkit-controller:dc331cb22850be0cdd97c84a9cfecaf44a1afb6e
untagged: myjenkins-blueocean:2.332.3-1
deleted: sha256:f414ed9f6cd2b60ae5867324700c2a45e27264fdd35abddee38ae16899dc9d0f
deleted: sha256:f0cea31942b5573e09ef6341e2b393ca17e9b4e1dc6e91d3d3979e104f653000
deleted: sha256:1339eaac5b67d16d6d9f41fb7a7b96f7cebf3ba4beab36cbb60935aa772af583
deleted: sha256:ee7fe1de523477eca2eb90fe79bed0deebd6d31c705127e1d9cdd4cc4c1397b4
deleted: sha256:a167e5ee9d3d3ffd6cde558495dba214573df628c6ca12eec6a60f3b6ca5c527
deleted: sha256:635f2040c45de6fbf42620356288b5d627a377fa8bd6ff9fe35187657ec6051d
deleted: sha256:0de24a2d2be853abdcd06832a09e57d7678175268d93f94feee70a7d0b3977a0
deleted: sha256:523f7f5f5298bb07c6110e61de11cb6b50895c533152931ea83a9037934eac23
deleted: sha256:0417692c0dbbb11b57c6287addd8d86f81829bb4353678e9c8728aa0dc99460d
deleted: sha256:8ad508db83b2bc8f75d959d645822d0c7510d9e66db5a5b9c0c29bc8b3dbfe34
deleted: sha256:91d64a25931af66d77a9c7627661742b174881dd87e3ba0e2b07fd2109c93677
deleted: sha256:6432ac88896af5f44091e20c7c8d4c4636ca3f8920bcd35f56abdf31b4f060c1
deleted: sha256:427fea71d52896f96dda6aa0ce682689329632c6f043331b79e11b847516f0de
deleted: sha256:8b9f06c8766130cb2a99038d76ee6b7feb3bfec905771272e807cb97acacfe75
deleted: sha256:7145f515d9228af08c45d387eac4fd0cb448acb106c927cc4d3b673973ed681f
deleted: sha256:97599d4b06aa37ca6727f9ef562a3ddcc90f3ea6022649f90369c62ac70dd10a
deleted: sha256:c0de4b3e376cf35f8d50cd74a0b9e523669624379ee94df23cdff4572eab4c46
deleted: sha256:253de6ee3d92989ac98af9c53bf43fc3e891d7361e7cfd3b638608bbd8e32d1d
deleted: sha256:fcc3b5be0cfb2056bd2d8235e93b27c5d4c56067584dfa81d951d2fba5a1e7fc
deleted: sha256:638c2322f09a298fec314a55c450781d9c9de5a7fa23134dcf462c0ef44f41b3
deleted: sha256:e90424c20795504fe8f9099880d512c00d4df26b6d506a508f13f033deceb46d
untagged: registry.k8s.io/coredns/coredns:v1.11.1
untagged: registry.k8s.io/kube-apiserver:v1.30.2
untagged: registry.k8s.io/kube-controller-manager:v1.30.2

Deleted build cache objects:
k1qm37h28cxea9s9712f3ba73
rdjvr3g6eswb5n8d9qiepkzw1

Total reclaimed space: 1.26GB

@VallariAg

@AyishikD
Copy link
Author

AyishikD commented Oct 1, 2024

Hey @VallariAg did you see the latest problem?

@VallariAg
Copy link
Member

Can you try to clean up all changes from docker-compose and run start.sh again?

@AyishikD
Copy link
Author

AyishikD commented Oct 6, 2024

I cleaned the docker.compose file and returned it to the original state and ran

./start.sh

But still the same error is coming

#27 [teuthology  5/12] RUN     cd /teuthology &&     mkdir ../archive_dir &&     mkdir log &&     chmod +x /teuthology/bootstrap &&     PIP_INSTALL_FLAGS="-r requirements.txt" ./bootstrap
#27 13.67 /bin/sh: 1: ./bootstrap: not found
#27 ERROR: process "/bin/sh -c cd /teuthology &&     mkdir ../archive_dir &&     mkdir log &&     chmod +x /teuthology/bootstrap &&     PIP_INSTALL_FLAGS=\"-r requirements.txt\" ./bootstrap" did not complete successfully: exit code: 127

#20 [testnode] exporting to image
#20 exporting layers 31.5s done
#20 CANCELED
------
 > [teuthology  5/12] RUN     cd /teuthology &&     mkdir ../archive_dir &&     mkdir log &&     chmod +x /teuthology/bootstrap &&     PIP_INSTALL_FLAGS="-r requirements.txt" ./bootstrap:
13.67 /bin/sh: 1: ./bootstrap: not found
------
failed to solve: process "/bin/sh -c cd /teuthology &&     mkdir ../archive_dir &&     mkdir log &&     chmod +x /teuthology/bootstrap &&     PIP_INSTALL_FLAGS=\"-r requirements.txt\" ./bootstrap" did not complete successfully: exit code: 127

@VallariAg

@VallariAg
Copy link
Member

Hmm seems weird. Can you see if there are any other changes on your local teuthology repo?

@kamoltat do you know what could be the issue here?

@AyishikD
Copy link
Author

AyishikD commented Oct 7, 2024

Hmm seems weird. Can you see if there are any other changes on your local teuthology repo?

@kamoltat do you know what could be the issue here?

In the teuthology repo I had only changed the docker.compose file after which I had again resetted it but still the same error came.

@AyishikD
Copy link
Author

@VallariAg any update mam?

@VallariAg
Copy link
Member

VallariAg commented Oct 28, 2024

@AyishikD I still don't understand the cause of the problem. If you're available, you can join "Teuthology weekly" call today at 8pm IST using this link https://meet.jit.si/ceph-teuthology.
This meeting is hosted every Monday so you can join whichever week that works for you, checkout the community calendar here: https://ceph.io/en/community/meetups/

@AyishikD
Copy link
Author

@AyishikD I still don't understand the cause of the problem. If you're available, you can join "Teuthology weekly" call today at 8pm IST using this link https://meet.jit.si/ceph-teuthology. This meeting is hosted every Monday so you can join whichever week which suites you, checkout the community calendar here: https://ceph.io/en/community/meetups/

Sure mam I am joining today only in meet.

@AyishikD
Copy link
Author

@VallariAg fixed postgresql error by using the commands

 chmod +x ./db/01-init.sh
 dos2unix ./db/01-init.sh

and in the 01-init.sh changed to

set -e
export PGPASSWORD=$POSTGRES_PASSWORD;
psql -v ON_ERROR_STOP=1 --username "$POSTGRES_USER" --dbname "$POSTGRES_DB" <<-EOSQL
 CREATE USER $APP_DB_USER WITH PASSWORD '$APP_DB_PASS';
 CREATE DATABASE $APP_DB_NAME;
 GRANT ALL PRIVILEGES ON DATABASE $APP_DB_NAME TO $APP_DB_USER;
 \connect $APP_DB_NAME $APP_DB_USER;
EOSQL

But now error is coming as

|
postgres-1    | PostgreSQL Database directory appears to contain a database; Skipping initialization
postgres-1    |
postgres-1    | 2024-10-28 15:24:53.436 UTC [1] LOG:  starting PostgreSQL 14.13 (Debian 14.13-1.pgdg120+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit
postgres-1    | 2024-10-28 15:24:53.439 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
postgres-1    | 2024-10-28 15:24:53.439 UTC [1] LOG:  listening on IPv6 address "::", port 5432
postgres-1    | 2024-10-28 15:24:53.454 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
postgres-1    | 2024-10-28 15:24:53.474 UTC [26] LOG:  database system was interrupted; last known up at 2024-10-28 15:18:13 UTC
postgres-1    | 2024-10-28 15:24:54.255 UTC [26] LOG:  database system was not properly shut down; automatic recovery in progress
postgres-1    | 2024-10-28 15:24:54.261 UTC [26] LOG:  redo starts at 0/17001E0
postgres-1    | 2024-10-28 15:24:54.265 UTC [26] LOG:  invalid record length at 0/17010F8: wanted 24, got 0
postgres-1    | 2024-10-28 15:24:54.265 UTC [26] LOG:  redo done at 0/17010A0 system usage: CPU: user: 0.00 s, system: 0.00 s, elapsed: 0.00 s
postgres-1    | 2024-10-28 15:24:54.349 UTC [1] LOG:  database system is ready to accept connections
paddles-1     | + trap exit TERM
paddles-1     | + pecan populate config.py
paddles-1     | ==> LOADING ENVIRONMENT
paddles-1     | ==> BUILDING SCHEMA
paddles-1     | ==> STARTING A TRANSACTION...
paddles-1     | ==> COMMITING...
paddles-1     | + alembic current
paddles-1     | INFO  [alembic.runtime.migration] Context impl PostgresqlImpl.
paddles-1     | INFO  [alembic.runtime.migration] Will assume transactional DDL.
paddles-1     | No current revision; assuming no migration necessary
paddles-1     | + CURRENT=
paddles-1     | + '[' -z  ]
paddles-1     | + echo 'No current revision; assuming no migration necessary'
paddles-1     | + alembic stamp head
paddles-1     | INFO  [alembic.runtime.migration] Context impl PostgresqlImpl.
paddles-1     | INFO  [alembic.runtime.migration] Will assume transactional DDL.
paddles-1     | INFO  [alembic.runtime.migration] Running stamp_revision  -> e8de4928657
paddles-1     | + '['  '=' false ]
paddles-1     | + '[' -n  ]
paddles-1     | + gunicorn_pecan -c gunicorn_config.py config.py
paddles-1     | [2024-10-28 15:25:53 +0000] [14] [INFO] Starting gunicorn 20.0.4
paddles-1     | [2024-10-28 15:25:53 +0000] [14] [INFO] Listening at: http://0.0.0.0:8080 (14)
paddles-1     | [2024-10-28 15:25:53 +0000] [14] [INFO] Using worker: sync
paddles-1     | [2024-10-28 15:25:54 +0000] [24] [INFO] Booting worker with pid: 24
paddles-1     | [2024-10-28 15:25:54 +0000] [23] [INFO] Booting worker with pid: 23
Gracefully stopping... (press Ctrl+C again to force)
dependency failed to start: container docker-compose-paddles-1 is unhealthy

unhealthy :(

@AyishikD
Copy link
Author

@VallariAg At ubuntu distro in wsl same error on running ./start.sh

 CACHED [teuthology  4/14] COPY requirements.txt requirements.yml ansible.cfg bootstrap /teuthology/            0.0s
 => ERROR [teuthology  5/14] RUN     cd /teuthology &&     mkdir ../archive_dir &&     mkdir log &&     chmod +x   7.9s
------
 > [teuthology  5/14] RUN     cd /teuthology &&     mkdir ../archive_dir &&     mkdir log &&     chmod +x /teuthology/bootstrap &&     PIP_INSTALL_FLAGS="-r requirements.txt" ./bootstrap:
7.598 /bin/sh: 1: ./bootstrap: not found
------
failed to solve: process "/bin/sh -c cd /teuthology &&     mkdir ../archive_dir &&     mkdir log &&     chmod +x /teuthology/bootstrap &&     PIP_INSTALL_FLAGS=\"-r requirements.txt\" ./bootstrap" did not complete successfully: exit code: 127

Bootstrap error..
And well, Happy Diwali!!!

@AyishikD
Copy link
Author

Hii @VallariAg sorry for disturbing , did u check it?

@VallariAg
Copy link
Member

Sorry I was on vacation, happy diwali @AyishikD :)
I haven't had a change to check it again yet. It's weird that it didn't work for you even on ubuntu (since github's CI integration test passed on ubuntu). Can you please share your ubuntu version too? I will schedule this for windows on github actions and let you know what I see. This is an odd error indeed. Thanks for the patience!

@AyishikD
Copy link
Author

Sorry I was on vacation, happy diwali @AyishikD :) I haven't had a change to check it again yet. It's weird that it didn't work for you even on ubuntu (since github's CI integration test passed on ubuntu). Can you please share your ubuntu version too? I will schedule this for windows on github actions and let you know what I see. This is an odd error indeed. Thanks for the patience!

@VallariAg my Ubuntu version is 22.04.05 LTS. Also, the code that sir told me in the meeting is running and creating a container, but the code which is actually here in teuthology does not work and gives an error. Thank you mam for your so much guidance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Disable github authentication for dev setup
2 participants