Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug(impala) A delimited table should be explicitly stored as textfile #4260

Closed
yi-you opened this issue Jul 21, 2022 · 1 comment · Fixed by #4271
Closed

bug(impala) A delimited table should be explicitly stored as textfile #4260

yi-you opened this issue Jul 21, 2022 · 1 comment · Fixed by #4271
Labels
bug Incorrect behavior inside of ibis ddl Issues related to creating or altering data definitions impala The Apache Impala backend
Milestone

Comments

@yi-you
Copy link
Contributor

yi-you commented Jul 21, 2022

class DelimitedFormat:

when the cluster's default format is set as parquet, this will cause an exception. It should be explicitly stored as textfile. such as

        if self.lineterminator is not None:
            yield f"LINES TERMINATED BY '{self.lineterminator}'"

        yield 'STORED AS TEXTFILE'
        yield f"LOCATION '{self.path}'"
@cpcloud
Copy link
Member

cpcloud commented Jul 21, 2022

@yi-you Thanks for the issue. Would you mind submitting a pull request for this? Looks like you've already done most of the work!

@cpcloud cpcloud added bug Incorrect behavior inside of ibis impala The Apache Impala backend ddl Issues related to creating or altering data definitions labels Jul 21, 2022
@yi-you yi-you changed the title bug[impala] A delimited table should be implicitly stored as textfile bug(impala) A delimited table should be explicitly stored as textfile Jul 23, 2022
@cpcloud cpcloud added this to the 3.1 milestone Jul 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Incorrect behavior inside of ibis ddl Issues related to creating or altering data definitions impala The Apache Impala backend
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants