Skip to content
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

[NSE-681] Add floor & ceil expression support #682

Merged
merged 4 commits into from
Jan 7, 2022

Conversation

PHILO-HE
Copy link
Collaborator

@PHILO-HE PHILO-HE commented Jan 6, 2022

No description provided.

@github-actions
Copy link

github-actions bot commented Jan 6, 2022

#681

@PHILO-HE
Copy link
Collaborator Author

PHILO-HE commented Jan 6, 2022

This PR depends on oap-project/arrow#72.

@@ -62,7 +62,7 @@ echo "ARROW_SOURCE_DIR=${ARROW_SOURCE_DIR}"
echo "ARROW_INSTALL_DIR=${ARROW_INSTALL_DIR}"
mkdir -p $ARROW_SOURCE_DIR
mkdir -p $ARROW_INSTALL_DIR
git clone https://github.com/oap-project/arrow.git --branch arrow-4.0.0-oap $ARROW_SOURCE_DIR
git clone https://github.com/philo-he/arrow.git --branch floor $ARROW_SOURCE_DIR
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove this?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just reverted it at latest commit. Thanks!

@zhouyuan zhouyuan merged commit 1ff6ee5 into oap-project:master Jan 7, 2022
zhouyuan pushed a commit to zhouyuan/native-sql-engine that referenced this pull request Jan 7, 2022
* Initial commit

* Add ceil expression support

* Change arrow branch for unit test [will revert at last]

* Revert "Change arrow branch for unit test [will revert at last]"

This reverts commit 5fb2f4b.
zhouyuan added a commit that referenced this pull request Jan 9, 2022
* Use Hadoop 3.2 as default hadoop.version (#652)

* [NSE-661] Add left/right trim in WSCG

* [NSE-675] Add instr expression support (#676)

* Initial commit

* Add the support in wscg

* [NSE-674] Add translate expression support (#672)

* Initial commit

* Add StringTranslate for subquery checking

* Code refactor

* Change arrow branch for unit test [will revert at last]

* Revert "Change arrow branch for unit test [will revert at last]"

This reverts commit bf74356.

* Port the function to wscg

* Change arrow branch for unit test [will revert at last]

* Format native code

* Fix a bug

* Revert "Change arrow branch for unit test [will revert at last]"

This reverts commit 3a53fa2.

* [NSE-681] Add floor & ceil expression support (#682)

* Initial commit

* Add ceil expression support

* Change arrow branch for unit test [will revert at last]

* Revert "Change arrow branch for unit test [will revert at last]"

This reverts commit 5fb2f4b.

* [NSE-647] Leverage buffered write in shuffle  (#648)

Closes #647

* [NSE-400] Native Arrow Row to columnar support (#637)

* Support ArrowRowToColumnar Optimization

* Replace expired code

* Add the code to convert recordbatch to columnarBatch

* Add unit test on java size

* Update the unit tests

* Fix the bug when reading decimal value from unsafeRow

* Use ArrowRowToColumnarExec instead of RowToArrowColumnarExec

* Use clang-format to standardize the CPP code format

* enable arrowRowToColumnarExec

* Add the metrics for ArrowRowToColumnarExec

* Add the metrics for ArrowRowToColumnarExec and unsupport Codegen

* Add parameter 'spark.oap.sql.columnar.rowtocolumnar' to control ArrowRowToColumnarExec

* Remove useless code

* Release arrowbuf after return recordbatch

* Fix the processTime metric for ArrowRowToColumnarExec

* Refine the code of ArrowRowToColumnar operator

* Add more metrics to detect the elapse time of each action

* Small fix about allocating buffer for unsafeRow

* Remove useless code

* Remove useless metrics for ArrowRowToColumnarExec

* Fall back to use java RowToColumnarExec when the row is not unsafeRow Type

* Fix the bug for decimal format

* fix format

Co-authored-by: Yuan Zhou <yuan.zhou@intel.com>

* fix leakage in rowtocolumn (#683)

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>

Co-authored-by: Wei-Ting Chen <weiting.chen@intel.com>
Co-authored-by: PHILO-HE <feilong.he@intel.com>
Co-authored-by: Hongze Zhang <hongze.zhang@intel.com>
Co-authored-by: haojinIntel <hao.jin@intel.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants