[Feature Request]: Upgrade to Gradle 8

[Abacn]

What would you like to happen?

So far, the latest gradle supports up to Java 20. As Java 21 support is planned, this would require gradle at least > 8.

Blocks #28120

Issue Priority

Priority: 2 (default / most feature requests should be filed as P2)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[Abacn]

Note that we currently see warning messages like

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

very often during a build. So this task requires identify and fix those deprecated gradle features

Known deprecation:

Configure project :sdks:java:core
The org.gradle.util.ClosureBackedAction type has been deprecated. This is scheduled to be removed in Gradle 9.0. Consult the upgrading guide for further information: https://docs.gradle.org/7.6.2/userguide/upgrading_version_7.html#org_gradle_util_reports_deprecations
at build_3ncpxweerxmaf7xb8tj1p0f5c.run(/Users/yathu/beam/sdks/java/core/build.gradle:20)
(Run with --stacktrace to get the full stack trace of this deprecation warning.)

Task :model:pipeline:generateProto
Relying on FileTrees for ignoring empty directories when using @SkipWhenEmpty has been deprecated. This is scheduled to be removed in Gradle 8.0. Annotate the property sourceFiles with @IgnoreEmptyDirectories or remove @SkipWhenEmpty. Consult the upgrading guide for further information: https://docs.gradle.org/7.6.2/userguide/upgrading_version_7.html#empty_directories_file_tree

[Abacn]

com.palantir.docker plugin used in applyDockerNature is defunct on gradle 8, and the plugin won't get updated: palantir/gradle-docker#573

Currently beam uses v0.34 for this plugin; update to 0.35.0 showing the error:

com/palantir/gradle/docker/DockerComponent has been compiled by a more recent version of the Java Runtime
(class file version 55.0), this version of the Java Runtime only recognizes class file versions up to 52.0

the 0.35.0 version was compiled on Java 11, which is no longer compatible with Beam.

This currently blocks Gradle 8 upgrade for beam. We have to migrate off from this plugin.