Skip to content
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

TPC-DS q67 failed for XXH3_hashLong_64b_withSecret.constprop.0+0x180 #241

Closed
joshuayao opened this issue Apr 9, 2021 · 2 comments · Fixed by #266
Closed

TPC-DS q67 failed for XXH3_hashLong_64b_withSecret.constprop.0+0x180 #241

joshuayao opened this issue Apr 9, 2021 · 2 comments · Fixed by #266
Labels
bug Something isn't working

Comments

@joshuayao
Copy link

Binary: ww15
Query: TPC-DS q67

Exception
Driver: Error: Error running query: java.lang.IllegalStateException: Writer index cannot be less than reader index (state=,code=0)
Executor:
C [libspark_columnar_jni.so+0x738ae0] XXH3_hashLong_64b_withSecret.constprop.0+0x180
@zhouyuan
Copy link
Collaborator

zhouyuan commented Apr 9, 2021

#242 might be related

@zhouyuan zhouyuan added the bug Something isn't working label Apr 9, 2021
@github-actions github-actions bot mentioned this issue Apr 15, 2021
Merged
@zhouyuan
Copy link
Collaborator

@joshuayao
reproduced here in my env. the issue seems related with shuffle partition size, with some specific shuffle partitions, non byte-aligned results are generated in hashagg. will dig into this.

@zhouyuan zhouyuan pinned this issue Apr 16, 2021
@zhouyuan zhouyuan mentioned this issue Apr 21, 2021
Merged
@zhixingheyi-tian zhixingheyi-tian unpinned this issue Apr 22, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[NSE-265] Reserve enough memory before UnsafeAppend in builder JkSelf/native-sql-engine
2 participants
@zhouyuan @joshuayao