Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

no support for docker_image option for creating clusters #815

Open
tplass-ias opened this issue Jul 14, 2023 · 0 comments
Open

no support for docker_image option for creating clusters #815

tplass-ias opened this issue Jul 14, 2023 · 0 comments

Comments

@tplass-ias
Copy link

tplass-ias commented Jul 14, 2023

Expected Behavior

Current Behavior

missing support for specifying docker image to use via dbx deployment.yaml

Steps to Reproduce (for bugs)

  1. follow code path for handling job_clusters options
  2. underlying class has no option mentioning docker or containers:
    spark_version: str
    node_type_id: Optional[str]
    num_workers: Optional[int]
    autoscale: Optional[AutoScale]
    instance_pool_name: Optional[str]
    driver_instance_pool_name: Optional[str]
    driver_instance_pool_id: Optional[str]
    instance_pool_id: Optional[str]
    aws_attributes: Optional[AwsAttributes]
    policy_name: Optional[str]
    policy_id: Optional[str]

Context

We are specifically looking for ECR support

Your Environment

  • dbx version used: v0.8.18 (inspected code in main while this was the latest version)
  • Databricks Runtime version: n/a
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant