Files cache refactoring

[bradmwilliams]

The files-cache has been using an emptyDir for it's underlying storage for ever. Recently, it exhausted all the available resources on the app.ci cluster and caused an outage. So, this PR is an overhaul of the files-cache:

1. Converting storage over to a 500Gb PersistentVolume

   • Attaching the volume at /mnt
   • Cache will be located at /mnt/cache

2. Adding an InitContainer

   • Creates the /mnt/cache directory if it doesn't exist
   • Purges all content matching /mnt/cache/4.* upon restarts

3. Refactoring Python code

   • Drop support for Python 2 based logic
   • Update code to work under /mnt/cache
   • Cleaned up and streamlined logic

[bradmwilliams]

/hold
This update is going to require manual intervention to update the statefulsets. The code will merge and deploy properly, but StatefulSets don't like you changing anything other than:

updates to statefulset spec for fields other than 'replicas', 'ordinals', 'template', 'updateStrategy', 'persistentVolumeClaimRetentionPolicy' and 'minReadySeconds' are forbidden

[jupierce]

/lgtm

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: bradmwilliams, jupierce

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [bradmwilliams,jupierce]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[openshift-bot]

Issues go stale after 90d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle stale

[openshift-bot]

Stale issues rot after 30d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle rotten
/remove-lifecycle stale

[bradmwilliams]

/remove-lifecycle rotten

[openshift-ci]

New changes are detected. LGTM label has been removed.

[openshift-ci]

@bradmwilliams: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/security	9492da4	link	false	/test security

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

[openshift-bot]

Issues go stale after 90d of inactivity.

Mark the issue as fresh by commenting /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
Exclude this issue from closing by commenting /lifecycle frozen.

If this issue is safe to close now please do so with /close.

/lifecycle stale

[bradmwilliams]

/close

[openshift-ci]

@bradmwilliams: Closed this PR.

In response to this:

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.