Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adopting devfiles for registry development setups #1069

Open
1 of 2 tasks
michael-valdron opened this issue Mar 21, 2023 · 15 comments · May be fixed by devfile/registry-support#195
Open
1 of 2 tasks

Adopting devfiles for registry development setups #1069

michael-valdron opened this issue Mar 21, 2023 · 15 comments · May be fixed by devfile/registry-support#195
Assignees
Labels
area/landing-page Issues with the Landing Page area/registry Devfile registry for stacks and infrastructure area/registry-viewer devtools-week kind/user-story User story for new enhancement

Comments

@michael-valdron
Copy link
Member

michael-valdron commented Mar 21, 2023

/kind user-story

Which area this user story is related to?

/area registry
/area registry-viewer
/area landing-page

User Story

As a developer working on devfile registry services there is a need to optimize the development process, luckily the development tools that use devfiles can provide this benefit. I want to have a devfile to define the development setup for testing, debugging and deploying devfile registry development projects, so that these essential workflows can be performed in a efficient manner.

In addition, adopting the spec which these services being developed supports allows those of us contributing to the devfile spec to make improvements and provide feedback to consumers of the spec (the developer tools) in a efficient manner.

Acceptance Criteria

Devfiles should be created under these repositories:

@michael-valdron michael-valdron self-assigned this Mar 21, 2023
@openshift-ci openshift-ci bot added kind/user-story User story for new enhancement area/registry Devfile registry for stacks and infrastructure area/registry-viewer area/landing-page Issues with the Landing Page labels Mar 21, 2023
@michael-valdron
Copy link
Member Author

michael-valdron commented Mar 24, 2023

Completion blocked by redhat-developer/odo#5694 due to requirements for the container build processes.

@michael-valdron
Copy link
Member Author

michael-valdron commented Mar 30, 2023

Timeline updated to continue work after odo v3.9.0 milestone is met, April 6, 2023. Currently, devfiles for both devfile-web and registry-support have been setup with the build process and development deployments defined as intended.

This issue should be added to the next sprint to account for the target date.

@michael-valdron
Copy link
Member Author

Timeline updated to continue work after odo v3.9.0 milestone is met, April 6, 2023. Currently, devfiles for both devfile-web and registry-support have been setup with the build process and development deployments defined as intended.

Release is out, continuing work on this issue.

@michael-valdron
Copy link
Member Author

I am running into an issue with the image component when building locally. With the current devfile-web devfile, I get the following error:

 •  Building image locally  ...
Error: accepts at most 1 arg(s), received 2
 ✗  Building image locally [31ms]
Cleaning resources, please wait
 ✗  error running podman command: exit status 125

But if I remove the args from the image component it runs without this error.

Opened discussion about in a thread on the odo slack channel: https://kubernetes.slack.com/archives/C01D6L2NUAG/p1681247236411709?thread_ts=1679082897.132979&cid=C01D6L2NUAG

@michael-valdron
Copy link
Member Author

I am running into an issue with the image component when building locally. With the current devfile-web devfile, I get the following error:

 •  Building image locally  ...
Error: accepts at most 1 arg(s), received 2
 ✗  Building image locally [31ms]
Cleaning resources, please wait
 ✗  error running podman command: exit status 125

But if I remove the args from the image component it runs without this error.

Opened discussion about in a thread on the odo slack channel: https://kubernetes.slack.com/archives/C01D6L2NUAG/p1681247236411709?thread_ts=1679082897.132979&cid=C01D6L2NUAG

Updating target date to end of sprint to provide more time for investigating this issue.

@michael-valdron
Copy link
Member Author

michael-valdron commented Apr 12, 2023

I am running into an issue with the image component when building locally. With the current devfile-web devfile, I get the following error:

 •  Building image locally  ...
Error: accepts at most 1 arg(s), received 2
 ✗  Building image locally [31ms]
Cleaning resources, please wait
 ✗  error running podman command: exit status 125

But if I remove the args from the image component it runs without this error.
Opened discussion about in a thread on the odo slack channel: https://kubernetes.slack.com/archives/C01D6L2NUAG/p1681247236411709?thread_ts=1679082897.132979&cid=C01D6L2NUAG

Updating target date to end of sprint to provide more time for investigating this issue.

Explicitly adding --build-arg before the build arg assignment fixes this error. Now running into an error during a build step:

error: cannot update repo 'rhel-8-for-x86_64-appstream-rpms': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried; Last error: Curl error (6): Couldn't resolve host name for https://sat6csbcap01.sate-005.prod.us-east-1.aws.redhat.com/pulp/content//CSB/lce-production-rhel-csb-8/cv-rhel-8-csb/content/dist/rhel8/8/x86_64/appstream/os/repodata/repomd.xml [Could not resolve host: sat6csbcap01.sate-005.prod.us-east-1.aws.redhat.com]
Error: error building at STEP "RUN microdnf install shadow-utils -y": error while running runtime: exit status 1
 ✗  Building image locally [5m]
Cleaning resources, please wait
 ✗  error running podman command: exit status 1

@michael-valdron
Copy link
Member Author

I am running into an issue with the image component when building locally. With the current devfile-web devfile, I get the following error:

 •  Building image locally  ...
Error: accepts at most 1 arg(s), received 2
 ✗  Building image locally [31ms]
Cleaning resources, please wait
 ✗  error running podman command: exit status 125

But if I remove the args from the image component it runs without this error.
Opened discussion about in a thread on the odo slack channel: https://kubernetes.slack.com/archives/C01D6L2NUAG/p1681247236411709?thread_ts=1679082897.132979&cid=C01D6L2NUAG

Updating target date to end of sprint to provide more time for investigating this issue.

Explicitly adding --build-arg before the build arg assignment fixes this error. Now running into an error during a build step:

error: cannot update repo 'rhel-8-for-x86_64-appstream-rpms': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried; Last error: Curl error (6): Couldn't resolve host name for https://sat6csbcap01.sate-005.prod.us-east-1.aws.redhat.com/pulp/content//CSB/lce-production-rhel-csb-8/cv-rhel-8-csb/content/dist/rhel8/8/x86_64/appstream/os/repodata/repomd.xml [Could not resolve host: sat6csbcap01.sate-005.prod.us-east-1.aws.redhat.com]
Error: error building at STEP "RUN microdnf install shadow-utils -y": error while running runtime: exit status 1
 ✗  Building image locally [5m]
Cleaning resources, please wait
 ✗  error running podman command: exit status 1

Seems that this error was only a one time problem with the package repository and is no longer happening.

@michael-valdron
Copy link
Member Author

For the devfile-web repository, I have decided to setup the devfile to only build and run the project from within the runtime container using node:16-alpine, there is a seperate image component used for building and deploying the container image for the target project. The devfile now look like this: https://github.com/michael-valdron/devfile-web/blob/e8c734976fa103751e8db01555038c451dc79c5f/.devfile.yaml

The devfile registry devfile will still use image components with autoBuild to build the images used by the runtime containers.

The PR for adding a devfile to devfile-web is now ready for review: devfile/devfile-web#78

@michael-valdron
Copy link
Member Author

michael-valdron commented Apr 17, 2023

devfile/devfile-web#78 has been merged and devfile for devfile-web is now available for use.

@michael-valdron
Copy link
Member Author

devfile/devfile-web#78 has been merged and devfile for devfile-web is now available for use.

Additional time on the second task of this issue is needed due to set backs involving deployment errors when the container components are attempting to execute the entrypoint commands. This issue will now be targeted for the upcoming sprint.

@michael-valdron
Copy link
Member Author

Running into issues with the OCI registry component, it needs to be provided with a config.yml. I was attempt to mount source directory to this component as it is not needed for the devfile registry component due to building the images on start.

There is an error that occurs at the start which prevents me from syncing a config.yml to the OCI registry.

◓  Syncing files into the containerE0427 17:48:51.643832  114216 v2.go:104] write tcp 192.168.39.1:42458->192.168.39.33:8443: write: connection reset by peer
 ✗  Command 'tar xf - -C /projects --no-same-owner' in container failed.

 ✗  stdout: OCI runtime exec failed: exec failed: unable to start container process: exec: "tar": executable file not found in $PATH: unknown


 ✗  stderr: 

 ✗  err: error while streaming command: command terminated with exit code 126

 ✗  Syncing files into the container [3s]
Error occurred on Push - watch command was unable to push component: failed to sync to component with name devfile-registry: failed to sync to component with name devfile-registry: unable push files to pod: error while streaming command: command terminated with exit code 126

@michael-valdron
Copy link
Member Author

Progress on this issue has been stalled due to higher priority issues, setting back to "To do" and resetting target date.

@github-actions
Copy link

github-actions bot commented Aug 2, 2023

This issue is stale because it has been open for 90 days with no activity. Remove stale label or comment or this will be closed in 60 days.

@github-actions github-actions bot added the lifecycle/stale Stale items. These items have not been updated for 90 days. label Aug 2, 2023
@michael-valdron
Copy link
Member Author

Preserve this issue for later sprint or devtools week Q3/Q4.

@github-actions github-actions bot removed the lifecycle/stale Stale items. These items have not been updated for 90 days. label Aug 3, 2023
@michael-valdron
Copy link
Member Author

Related issue: #1200
Related PR for registry-support devfile: devfile/registry#256

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/landing-page Issues with the Landing Page area/registry Devfile registry for stacks and infrastructure area/registry-viewer devtools-week kind/user-story User story for new enhancement
Projects
Status: Backlog
2 participants