Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-26019][PYSPARK] Allow insecure py4j gateways #23337

Closed
wants to merge 5 commits into from

Commits on Dec 17, 2018

  1. [SPARK-26019][PYSPARK] Allow insecure py4j gateways

    Spark always creates secure py4j connections between java and python,
    but it also allows users to pass in their own connection.  This restores
    the ability for users to pass in an _insecure_ connection, though it
    forces them to set 'spark.python.allowInsecurePy4j=true' and still
    issues a warning.
    
    Added test cases verifying the failure without the extra configuration,
    and verifying things still work with an insecure configuration (in
    particular, accumulators, as those were broken with an insecure py4j
    gateway before).
    squito committed Dec 17, 2018
    Configuration menu
    Copy the full SHA
    c891464 View commit details
    Browse the repository at this point in the history
  2. style

    squito committed Dec 17, 2018
    Configuration menu
    Copy the full SHA
    7b2d223 View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2018

  1. review feedback

    squito committed Dec 18, 2018
    Configuration menu
    Copy the full SHA
    e83b160 View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2018

  1. Configuration menu
    Copy the full SHA
    9cc545b View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2019

  1. style issues

    squito committed Jan 2, 2019
    Configuration menu
    Copy the full SHA
    c6e0811 View commit details
    Browse the repository at this point in the history