Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Drop support of Spark 2.4 #193

Closed
benedeki opened this issue Apr 22, 2024 · 0 comments · Fixed by #196
Closed

Drop support of Spark 2.4 #193

benedeki opened this issue Apr 22, 2024 · 0 comments · Fixed by #196
Assignees
@benedeki
Labels
Agent Issues touching the agent part of the project enhancement New feature or request refactoring Improving code quality, paying off tech debt, aligning API, cleanup of unused code

Comments

@benedeki
Copy link
Contributor

Background

The support of Spark 2.4 is causing problems when building Atum service project.

Feature

Drop the support of Spark 2.4 (probably Scala 2.11 can go too)
@benedeki benedeki added the enhancement New feature or request label Apr 22, 2024
@benedeki benedeki moved this from 🆕 To groom to 🏗 In progress in CPS small repos project Apr 22, 2024
@benedeki benedeki self-assigned this Apr 22, 2024
@benedeki benedeki mentioned this issue Apr 22, 2024
Closed
@benedeki benedeki added Agent Issues touching the agent part of the project refactoring Improving code quality, paying off tech debt, aligning API, cleanup of unused code labels Apr 22, 2024
benedeki added a commit that referenced this issue May 15, 2024
@benedeki
#193: Drop support of Spark 2.4
b79f87a 
* dropping Spark 2.4 support
* strict use of sbt projectmatrix plugin, tohave cross-builds
* basic settings moved to `project/Setup.scala` class
* some move or project setup code to fall into logical areas
@benedeki benedeki mentioned this issue May 15, 2024
Merged
@benedeki benedeki moved this from 🏗 In progress to 👀 In review in CPS small repos project May 21, 2024
benedeki added a commit that referenced this issue May 22, 2024
@benedeki @lsulak
#193: Drop support of Spark 2.4 (#196)
8adf2b3 
* dropping Spark 2.4 support
* strict use of sbt projectmatrix plugin, tohave cross-builds
* basic settings moved to `project/Setup.scala` class
* some move or project setup code to fall into logical areas
* enhanced README.md to describe possible Spark 2.4 build
* increase version of sbt projectMatrix plugin
* using `SemVer` class for Scala versions instead of `String`
* moved publish related values into `publish.sbt`
* assembly fixed
* assembly plugin version upgraded
* commonSettings moved 
---------

Co-authored-by: Ladislav Sulak <laco.sulak@gmail.com>
@github-project-automation github-project-automation bot moved this from 👀 In review to ✅ Done in CPS small repos project May 22, 2024
@salamonpavel salamonpavel mentioned this issue May 22, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@benedeki benedeki

Labels
Agent Issues touching the agent part of the project enhancement New feature or request refactoring Improving code quality, paying off tech debt, aligning API, cleanup of unused code
Projects
CPS small repos project
Archived in project
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

#193: Drop support of Spark 2.4 AbsaOSS/atum-service
1 participant
@benedeki