allow extraPipPackages
to only install once (using PVC)
#104
Labels
kind/enhancement
kind - new features or changes
status/help-wanted
status - this needs contributions
Milestone
Currently we use an init-container for all the
*. extraPipPackages
values, which must run every time the Pod starts.This issue is worst for the
airflow.kubernetesPodTemplate.extraPipPackages
value, (which is related to thepod_template.yaml
generation), as it means that users are installing those packages for literally EVERY TASK in thier DAGs.I believe it would be possible to optionally allow the usage of a PVC rather than ephemeral volume, which would mean that pip-install only runs one-time per
helm upgrade/install
through the use of pre-install helm-hook Jobs.(NOTE: it needs to be PRE-install because the user might install something like
python-ldap
for their webserver to be able to start)The text was updated successfully, but these errors were encountered: