Skip to content

Build script for spark container image to be used with spark k8s operator

License

Notifications You must be signed in to change notification settings

jklegar/spark-container-image

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This builds a container image for Spark 3.0.1 with two tweaks:

  1. a patch that makes it backwards compatible with spark k8s operator v1beta2-1.1.2-2.4.5
  2. added AWS libraries

The image is publicly available as gcr.io/kf-feast/spark-py:v3.0.1

About

Build script for spark container image to be used with spark k8s operator

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Dockerfile 71.6%
  • Shell 28.4%