Skip to content

Commit

Permalink
Update Release Notes|News|Downloads Links for v3.5.3
Browse files Browse the repository at this point in the history
<!-- *Make sure that you generate site HTML with `bundle exec jekyll build`, and include the changes to the HTML in your pull request. See README.md for more information.* -->

This PR proposes to update Release Notes|News|Downloads Links for v3.5.3

https://issues.apache.org/jira/projects/SPARK/versions/12354954

Author: Haejoon Lee <haejoon.lee@databricks.com>

Closes #558 from itholic/release_note.
  • Loading branch information
itholic authored and HyukjinKwon committed Sep 24, 2024
1 parent 02dd534 commit 0de4677
Show file tree
Hide file tree
Showing 254 changed files with 1,330 additions and 739 deletions.
1 change: 1 addition & 0 deletions documentation.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,7 @@ navigation:
<p>Setup instructions, programming guides, and other documentation are available for each stable version of Spark below:</p>

<ul>
<li><a href="{{site.baseurl}}/docs/3.5.3/">Spark 3.5.3</a></li>
<li><a href="{{site.baseurl}}/docs/3.5.2/">Spark 3.5.2</a></li>
<li><a href="{{site.baseurl}}/docs/3.5.1/">Spark 3.5.1</a></li>
<li><a href="{{site.baseurl}}/docs/3.5.0/">Spark 3.5.0</a></li>
Expand Down
2 changes: 1 addition & 1 deletion downloads.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ Spark artifacts are [hosted in Maven Central](https://search.maven.org/search?q=

groupId: org.apache.spark
artifactId: spark-core_2.12
version: 3.5.2
version: 3.5.3

### Installing with PyPi
<a href="https://pypi.org/project/pyspark/">PySpark</a> is now available in pypi. To install just run `pip install pyspark`.
Expand Down
2 changes: 1 addition & 1 deletion js/downloads.js
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ var hadoop3pscala213 = {pretty: "Pre-built for Apache Hadoop 3.3 and later (Scal
// 3.4.0+
var packagesV14 = [hadoop3p, hadoop3pscala213, hadoopFree, sources];

addRelease("3.5.2", new Date("08/10/2024"), packagesV14, true);
addRelease("3.5.3", new Date("09/24/2024"), packagesV14, true);
addRelease("3.4.3", new Date("04/18/2024"), packagesV14, true);

function append(el, contents) {
Expand Down
14 changes: 14 additions & 0 deletions news/_posts/2024-09-24-spark-3-5-3-released.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
---
layout: post
title: Spark 3.5.3 released
categories:
- News
tags: []
status: publish
type: post
published: true
meta:
_edit_last: '4'
_wpas_done_all: '1'
---
We are happy to announce the availability of <a href="{{site.baseurl}}/releases/spark-release-3-5-3.html" title="Spark Release 3.5.3">Spark 3.5.3</a>! Visit the <a href="{{site.baseurl}}/releases/spark-release-3-5-3.html" title="Spark Release 3.5.3">release notes</a> to read about the new features, or <a href="{{site.baseurl}}/downloads.html">download</a> the release today.
54 changes: 54 additions & 0 deletions releases/_posts/2024-09-24-spark-release-3-5-3.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
---
layout: post
title: Spark Release 3.5.3
categories: []
tags: []
status: publish
type: post
published: true
meta:
_edit_last: '4'
_wpas_done_all: '1'
---

Spark 3.5.3 is the third maintenance release containing security and correctness fixes. This release is based on the branch-3.5 maintenance branch of Spark. We strongly recommend all 3.5 users to upgrade to this stable release.

### Notable changes

- [[SPARK-49176]](https://issues.apache.org/jira/browse/SPARK-49176) - Fix `spark.ui.custom.executor.log.url` docs by adding K8s
- [[SPARK-49182]](https://issues.apache.org/jira/browse/SPARK-49182) - Stop publish site/docs/{version}/api/python/_sources
- [[SPARK-49197]](https://issues.apache.org/jira/browse/SPARK-49197) - Redact `Spark Command` output in `launcher` module
- [[SPARK-43242]](https://issues.apache.org/jira/browse/SPARK-43242) - diagnoseCorruption should not throw Unexpected type of BlockId for ShuffleBlockBatchId
- [[SPARK-46037]](https://issues.apache.org/jira/browse/SPARK-46037) - When Left Join build Left, ShuffledHashJoinExec may result in incorrect results
- [[SPARK-46632]](https://issues.apache.org/jira/browse/SPARK-46632) - EquivalentExpressions throw IllegalStateException
- [[SPARK-48965]](https://issues.apache.org/jira/browse/SPARK-48965) - toJSON produces wrong values if DecimalType information is lost in as[Product]
- [[SPARK-49030]](https://issues.apache.org/jira/browse/SPARK-49030) - Self join of a CTE seems non-deterministic
- [[SPARK-49038]](https://issues.apache.org/jira/browse/SPARK-49038) - Spark UI is showing wrong timing metrics for min and median time.
- [[SPARK-49039]](https://issues.apache.org/jira/browse/SPARK-49039) - Reset checkbox when executor metrics are loaded in the Stages tab
- [[SPARK-49179]](https://issues.apache.org/jira/browse/SPARK-49179) - Fix v2 multi bucketed inner joins throw AssertionError
- [[SPARK-49183]](https://issues.apache.org/jira/browse/SPARK-49183) - V2SessionCatalog.createTable should respect PROP_IS_MANAGED_LOCATION
- [[SPARK-49193]](https://issues.apache.org/jira/browse/SPARK-49193) - Improve the performance of RowSetUtils.toColumnBasedSet
- [[SPARK-49200]](https://issues.apache.org/jira/browse/SPARK-49200) - Fix null type non-codegen ordering exception
- [[SPARK-49300]](https://issues.apache.org/jira/browse/SPARK-49300) - Fix Hadoop delegation token leak when tokenRenewalInterval is not set.
- [[SPARK-49333]](https://issues.apache.org/jira/browse/SPARK-49333) - Shutdown timeout thread while cleaning up SparkExecuteStatementOperation
- [[SPARK-49352]](https://issues.apache.org/jira/browse/SPARK-49352) - Avoid redundant array transform for identical expression
- [[SPARK-49359]](https://issues.apache.org/jira/browse/SPARK-49359) - allow StagedTableCatalog implementations to fall back to non-atomic write
- [[SPARK-49381]](https://issues.apache.org/jira/browse/SPARK-49381) - Fix `SPARK-41388` test case to assert the result
- [[SPARK-49385]](https://issues.apache.org/jira/browse/SPARK-49385) - Fix `getReusablePVCs` to use `podCreationTimeout` instead of `podAllocationDelay`
- [[SPARK-49402]](https://issues.apache.org/jira/browse/SPARK-49402) - Fix Binder integration in PySpark documentation
- [[SPARK-49476]](https://issues.apache.org/jira/browse/SPARK-49476) - Base64 nullability change
- [[SPARK-49480]](https://issues.apache.org/jira/browse/SPARK-49480) - NullPointerException from SparkThrowableHelper.isInternalError method
- [[SPARK-49509]](https://issues.apache.org/jira/browse/SPARK-49509) - Use Platform.allocateDirectBuffer instead of ByteBuffer.allocateDirect
- [[SPARK-49628]](https://issues.apache.org/jira/browse/SPARK-49628) - ConstantFolding should copy stateful expression before evaluating
- [[SPARK-49699]](https://issues.apache.org/jira/browse/SPARK-49699) - Disable PruneFilters for streaming workloads
- [[SPARK-49152]](https://issues.apache.org/jira/browse/SPARK-49152) - V2SessionCatalog should use V2Command
- [[SPARK-49211]](https://issues.apache.org/jira/browse/SPARK-49211) - V2 Catalog can also support built-in data sources
- [[SPARK-49246]](https://issues.apache.org/jira/browse/SPARK-49246) - TableCatalog#loadTable should indicate if it's for writing
- [[SPARK-49275]](https://issues.apache.org/jira/browse/SPARK-49275) - Fix return type nullness of the xpath expression
- [[SPARK-49408]](https://issues.apache.org/jira/browse/SPARK-49408) - Poor performance in ProjectingInternalRow
- [[SPARK-49520]](https://issues.apache.org/jira/browse/SPARK-49520) - ArrayRemove() Function Need Remove NULL Value
- [[SPARK-45590]](https://issues.apache.org/jira/browse/SPARK-45590) - okio-1.15.0 CVE-2023-3635

You can consult JIRA for the [detailed changes](https://s.apache.org/spark-3.5.3).

We would like to acknowledge all community members for contributing patches to this release.
6 changes: 3 additions & 3 deletions site/404.html
Original file line number Diff line number Diff line change
Expand Up @@ -179,6 +179,9 @@ <h2 id="oops">Oops!</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

<li><a href="/news/spark-3-5-2-released.html">Spark 3.5.2 released</a>
<span class="small">(Aug 10, 2024)</span></li>

Expand All @@ -188,9 +191,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

<li><a href="/news/spark-3-5-1-released.html">Spark 3.5.1 released</a>
<span class="small">(Feb 23, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/committers.html
Original file line number Diff line number Diff line change
Expand Up @@ -714,6 +714,9 @@ <h3>Policy on backporting bug fixes</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

<li><a href="/news/spark-3-5-2-released.html">Spark 3.5.2 released</a>
<span class="small">(Aug 10, 2024)</span></li>

Expand All @@ -723,9 +726,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

<li><a href="/news/spark-3-5-1-released.html">Spark 3.5.1 released</a>
<span class="small">(Feb 23, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/community.html
Original file line number Diff line number Diff line change
Expand Up @@ -379,6 +379,9 @@ <h3>Powered by</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

<li><a href="/news/spark-3-5-2-released.html">Spark 3.5.2 released</a>
<span class="small">(Aug 10, 2024)</span></li>

Expand All @@ -388,9 +391,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

<li><a href="/news/spark-3-5-1-released.html">Spark 3.5.1 released</a>
<span class="small">(Feb 23, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/contributing.html
Original file line number Diff line number Diff line change
Expand Up @@ -722,6 +722,9 @@ <h2>Code of conduct</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

<li><a href="/news/spark-3-5-2-released.html">Spark 3.5.2 released</a>
<span class="small">(Aug 10, 2024)</span></li>

Expand All @@ -731,9 +734,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

<li><a href="/news/spark-3-5-1-released.html">Spark 3.5.1 released</a>
<span class="small">(Feb 23, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/developer-tools.html
Original file line number Diff line number Diff line change
Expand Up @@ -723,6 +723,9 @@ <h2>Generative tooling usage</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

<li><a href="/news/spark-3-5-2-released.html">Spark 3.5.2 released</a>
<span class="small">(Aug 10, 2024)</span></li>

Expand All @@ -732,9 +735,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

<li><a href="/news/spark-3-5-1-released.html">Spark 3.5.1 released</a>
<span class="small">(Feb 23, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
7 changes: 4 additions & 3 deletions site/documentation.html
Original file line number Diff line number Diff line change
Expand Up @@ -158,6 +158,7 @@ <h2><span class="text-capitalize">Apache Spark<span class="tm">&trade;</span></s
<p>Setup instructions, programming guides, and other documentation are available for each stable version of Spark below:</p>

<ul>
<li><a href="/docs/3.5.3/">Spark 3.5.3</a></li>
<li><a href="/docs/3.5.2/">Spark 3.5.2</a></li>
<li><a href="/docs/3.5.1/">Spark 3.5.1</a></li>
<li><a href="/docs/3.5.0/">Spark 3.5.0</a></li>
Expand Down Expand Up @@ -378,6 +379,9 @@ <h3>Research Papers</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

<li><a href="/news/spark-3-5-2-released.html">Spark 3.5.2 released</a>
<span class="small">(Aug 10, 2024)</span></li>

Expand All @@ -387,9 +391,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

<li><a href="/news/spark-3-5-1-released.html">Spark 3.5.1 released</a>
<span class="small">(Feb 23, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
8 changes: 4 additions & 4 deletions site/downloads.html
Original file line number Diff line number Diff line change
Expand Up @@ -188,7 +188,7 @@ <h3 id="link-with-spark">Link with Spark</h3>

<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>groupId: org.apache.spark
artifactId: spark-core_2.12
version: 3.5.2
version: 3.5.3
</code></pre></div></div>

<h3 id="installing-with-pypi">Installing with PyPi</h3>
Expand Down Expand Up @@ -219,6 +219,9 @@ <h3 id="archived-releases">Archived releases</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

<li><a href="/news/spark-3-5-2-released.html">Spark 3.5.2 released</a>
<span class="small">(Aug 10, 2024)</span></li>

Expand All @@ -228,9 +231,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

<li><a href="/news/spark-3-5-1-released.html">Spark 3.5.1 released</a>
<span class="small">(Feb 23, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/error-message-guidelines.html
Original file line number Diff line number Diff line change
Expand Up @@ -556,6 +556,9 @@ <h4 id="wording-guide">Wording guide</h4>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

<li><a href="/news/spark-3-5-2-released.html">Spark 3.5.2 released</a>
<span class="small">(Aug 10, 2024)</span></li>

Expand All @@ -565,9 +568,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

<li><a href="/news/spark-3-5-1-released.html">Spark 3.5.1 released</a>
<span class="small">(Feb 23, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/examples.html
Original file line number Diff line number Diff line change
Expand Up @@ -504,6 +504,9 @@ <h2>Additional examples</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

<li><a href="/news/spark-3-5-2-released.html">Spark 3.5.2 released</a>
<span class="small">(Aug 10, 2024)</span></li>

Expand All @@ -513,9 +516,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

<li><a href="/news/spark-3-5-1-released.html">Spark 3.5.1 released</a>
<span class="small">(Feb 23, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/faq.html
Original file line number Diff line number Diff line change
Expand Up @@ -226,6 +226,9 @@ <h2><span class="text-capitalize">Apache Spark<span class="tm">&trade;</span></s
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

<li><a href="/news/spark-3-5-2-released.html">Spark 3.5.2 released</a>
<span class="small">(Aug 10, 2024)</span></li>

Expand All @@ -235,9 +238,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

<li><a href="/news/spark-3-5-1-released.html">Spark 3.5.1 released</a>
<span class="small">(Feb 23, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/graphx/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -271,6 +271,9 @@ <h3>Getting started</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

<li><a href="/news/spark-3-5-2-released.html">Spark 3.5.2 released</a>
<span class="small">(Aug 10, 2024)</span></li>

Expand All @@ -280,9 +283,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

<li><a href="/news/spark-3-5-1-released.html">Spark 3.5.1 released</a>
<span class="small">(Feb 23, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/history.html
Original file line number Diff line number Diff line change
Expand Up @@ -180,6 +180,9 @@ <h2><span class="text-capitalize">Apache Spark<span class="tm">&trade;</span></s
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

<li><a href="/news/spark-3-5-2-released.html">Spark 3.5.2 released</a>
<span class="small">(Aug 10, 2024)</span></li>

Expand All @@ -189,9 +192,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

<li><a href="/news/spark-3-5-1-released.html">Spark 3.5.1 released</a>
<span class="small">(Feb 23, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/improvement-proposals.html
Original file line number Diff line number Diff line change
Expand Up @@ -252,6 +252,9 @@ <h4>Implementing an SPIP</h4>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

<li><a href="/news/spark-3-5-2-released.html">Spark 3.5.2 released</a>
<span class="small">(Aug 10, 2024)</span></li>

Expand All @@ -261,9 +264,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

<li><a href="/news/spark-3-5-1-released.html">Spark 3.5.1 released</a>
<span class="small">(Feb 23, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
2 changes: 1 addition & 1 deletion site/js/downloads.js
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ var hadoop3pscala213 = {pretty: "Pre-built for Apache Hadoop 3.3 and later (Scal
// 3.4.0+
var packagesV14 = [hadoop3p, hadoop3pscala213, hadoopFree, sources];

addRelease("3.5.2", new Date("08/10/2024"), packagesV14, true);
addRelease("3.5.3", new Date("09/24/2024"), packagesV14, true);
addRelease("3.4.3", new Date("04/18/2024"), packagesV14, true);

function append(el, contents) {
Expand Down
Loading

0 comments on commit 0de4677

Please sign in to comment.