Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-10949] Update Snappy version to 1.1.2 #9439

Closed
wants to merge 6 commits into from

Conversation

JoshRosen
Copy link
Contributor

This is an updated version of #8995 by @a-roberts. Original description follows:

Snappy now supports concatenation of serialized streams, this patch contains a version number change and the "does not support" test is now a "supports" test.

Snappy 1.1.2 changelog mentions:

snappy-java-1.1.2 (22 September 2015)
This is a backward compatible release for 1.1.x.
Add AIX (32-bit) support.
There is no upgrade for the native libraries of the other platforms.

A major change since 1.1.1 is a support for reading concatenated results of SnappyOutputStream(s)
snappy-java-1.1.2-RC2 (18 May 2015)
Fix #107: SnappyOutputStream.close() is not idempotent
snappy-java-1.1.2-RC1 (13 May 2015)
SnappyInputStream now supports reading concatenated compressed results of SnappyOutputStream
There has been no compressed format change since 1.0.5.x. So You can read the compressed results > interchangeablly between these versions.
Fixes a problem when java.io.tmpdir does not exist.

Closes #8995.

a-roberts and others added 6 commits October 6, 2015 17:19
Add known compression codecs that support concatenation of serialized streams
Update fastMergeIsSupported so we can support concatenation of serialized streams
Scalastyle fixes for whitespace
@JoshRosen
Copy link
Contributor Author

Jenkins, retest this please.

@SparkQA
Copy link

SparkQA commented Nov 4, 2015

Test build #44958 has finished for PR 9439 at commit f9a021b.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@rxin
Copy link
Contributor

rxin commented Nov 4, 2015

I'm going to merge this. Hopefully it will be OK -- in the past snappy change isn't always the most robust.

@asfgit asfgit closed this in 701fb50 Nov 4, 2015
@JoshRosen JoshRosen deleted the update-snappy branch August 29, 2016 19:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants