fix(CNV-53190): use emptyDir to store downloaded disk

[codingben]

What this PR does / why we need it:

Currently the downloaded disk image from
the source will be stored inside container's
temporary file system, that consumes RAM,
and instead it should be stored in the node's
storage by using emptyDir.

Release note:

Use emptyDir to store downloaded disk in disk-uploader.

[codingben]

/cc @jcanocan @lyarwood

[0xFelix]

Did you check what is a typical size for local ephemeral storage on nodes? It might be an issue to expect this storage to hold several hundred gigabytes.

https://kubernetes.io/docs/concepts/configuration/manage-resources-containers/#configurations-for-local-ephemeral-storage

Also, I think it's worth mentioning that streaming IO is preferable if possible.

[dominikholler]

Currently the downloaded disk image from
the source will be stored inside container's
temporary file system, that consumes RAM,
and instead it should be stored in the node's
storage by using emptyDir.

According to my understanding, it is not that simple.

I would write

The disk-uploader might take a significant amount of scratch space.
emptyDir is the the appropriate way to let kubernetes know about that. 

[codingben]

Did you check what is a typical size for local ephemeral storage on nodes? It might be an issue to expect this storage to hold several hundred gigabytes.

https://kubernetes.io/docs/concepts/configuration/manage-resources-containers/#configurations-for-local-ephemeral-storage

Good catch Felix. I didn't check the typical size. I think from customer's perspective, it's cheaper to use storage than memory (it's also mentioned in the docs you shared).

We can set something like this, to guarantee the usage of disk-uploader:

...
    resources:
      requests:
        ephemeral-storage: "2Gi"
      limits:
        ephemeral-storage: "10Gi"

Altough I need to investigate the maximum disk size we can download from the source, rebuild as a containerDisk and upload to the container registry - I'm not sure about the values yet.

Alos, I think it's worth mentioning that streaming IO is preferable if possible.

I agree, but streaming IO is not supported in Export API.

[0xFelix]

We can set something like this, to guarantee the usage of disk-uploader

Not sure what to recommend here. A disk might be larger than 10Gi before compressing it? How much scratch space is needed when working with a 10Gi disk? Will there be multiple copies of it?

[dominikholler]

I expect that the resources limits and requests has to be customizable. I would postpone this adjustment after we understood the limitations of the default config of quay.io .

[dominikholler]

My personal reference how to start is https://github.com/openshift-pipelines/tektoncd-catalog/blob/650a046c582e5a70719669fb7032a224ab42357e/tasks/task-buildah/0.5.0/task-buildah.yaml#L171 , because if it works for buildah, it would be a good starting point for the disk uploader task, too.

[codingben]

I expect that the resources limits and requests has to be customizable. I would postpone this adjustment after we understood the limitations of the default config of quay.io .

The image's storage config is set by MAXIMUM_LAYER_SIZE as mentioned in the Quay's docs [1]. The default config is 20gb and the user can set another value in the deployment of Quay.

[1] https://docs.projectquay.io/config_quay.html

[ksimon1]

/retest

[ksimon1]

/approve

[kubevirt-bot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ksimon1

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [ksimon1]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: codingben, ksimon1

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [ksimon1]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: codingben, ksimon1

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [ksimon1]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[jcanocan]

/lgtm