Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store resources being administered by the aggregated apiservice in a custom storage #42

Closed
anik120 opened this issue Apr 13, 2023 · 3 comments

Comments

@anik120
Copy link
Collaborator

anik120 commented Apr 13, 2023

Motivation:

As a follow up to #39, configure the aggregated apiservice to store the objects in a custom storage, so that the main etcd storage is not misused for storing the resources created by the catalog controller.

Some potential options:

@anik120
Copy link
Collaborator Author

anik120 commented Apr 13, 2023

cc: @joelanford I know you had some opinions about which storage is better suited for our use case, considering atomic availability of content from a catalog during creation/re-sync etc.

@anik120
Copy link
Collaborator Author

anik120 commented Apr 13, 2023

Also, initial thought is that it'll be cleaner to have this storage running in a separate pod, that the aggregated apiservice connects to using api endpoints, so that the apiservice process isn't also responsible for running the db in memory. That way, if the process running the db is unavailable for any reason (eg exceeded memory limits and therefore is getting kicked out by the main apiservice), the running aggregated apiservice is still available to communicate to clients that the storage is unavailable. This also off loads risks related to aggregated apiservice unavailability (I.e potential domino effects to the main apiservice)

@everettraven
Copy link
Collaborator

Closing this as a different route has been decided for storing and serving catalog contents. See #113 , #114, and #139 for more information

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

No branches or pull requests

2 participants