-
Notifications
You must be signed in to change notification settings - Fork 28.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-4825] [SQL] CTAS fails to resolve when created using saveAsTable #3673
Conversation
test this please |
Test build #24353 has started for PR 3673 at commit
|
Test build #24354 has started for PR 3673 at commit
|
Test build #24354 has finished for PR 3673 at commit
|
Test FAILed. |
Test build #24353 has finished for PR 3673 at commit
|
Test FAILed. |
Test build #24359 has started for PR 3673 at commit
|
Test build #24359 has finished for PR 3673 at commit
|
Test PASSed. |
@marmbrus Any comment on this? This is a blocker fixing. |
Thanks for the fast fix! Merged to master and 1.2 |
Fix bug when query like: ``` test("save join to table") { val testData = sparkContext.parallelize(1 to 10).map(i => TestData(i, i.toString)) sql("CREATE TABLE test1 (key INT, value STRING)") testData.insertInto("test1") sql("CREATE TABLE test2 (key INT, value STRING)") testData.insertInto("test2") testData.insertInto("test2") sql("SELECT COUNT(a.value) FROM test1 a JOIN test2 b ON a.key = b.key").saveAsTable("test") checkAnswer( table("test"), sql("SELECT COUNT(a.value) FROM test1 a JOIN test2 b ON a.key = b.key").collect().toSeq) } ``` Author: Cheng Hao <hao.cheng@intel.com> Closes #3673 from chenghao-intel/spark_4825 and squashes the following commits: e8cbd56 [Cheng Hao] alternate the pattern matching order for logical plan:CTAS e004895 [Cheng Hao] fix bug (cherry picked from commit 0abbff2) Signed-off-by: Michael Armbrust <michael@databricks.com>
Fix bug when query like: