Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-26094][CORE][STREAMING] createNonEcFile creates parent dirs. #23092

Closed
wants to merge 2 commits into from
Closed

[SPARK-26094][CORE][STREAMING] createNonEcFile creates parent dirs. #23092

wants to merge 2 commits into from

Commits on Nov 16, 2018

  1. [SPARK-26094][CORE][STREAMING] createNonEcFile creates parent dirs. 

    We explicitly avoid files with hdfs erasure coding for the streaming WAL
and for event logs, as hdfs EC does not support all relevant apis.
However, the new builder api used has different semantics -- it does not
create parent dirs, and it does not resolve relative paths.  This
updates createNonEcFile to have similar semantics to the old api.
    @squito
    squito committed Nov 16, 2018
    Configuration menu
    Copy the full SHA
    c52010a View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2018

  1. add error handling on mkdirs

    @squito
    squito committed Dec 3, 2018
    Configuration menu
    Copy the full SHA
    891e37c View commit details
    Browse the repository at this point in the history