You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Please, check there is no other feature request like this one to avoid duplicates: see doric issues
It seems this feature is not requested yet:
YES
Expected Behavior
Currently, there is no spark api function to order an array of structs using other columns or a custom order function, is is necessary to create an expression to do so. It would be nice to have the following functions:
array_sort function specifying the custom order columns
array_sort function specifying the custom lambda column
Current Behavior (if so)
Use the default ordering function or create an expression
The text was updated successfully, but these errors were encountered:
eruizalo
changed the title
[Feature request]: array_sort function with lambda
[Feature request]: β¬οΈ π π array_sort function with lambda
Aug 24, 2022
eruizalo
added a commit
to eruizalo/doric
that referenced
this issue
Aug 29, 2022
- [feat] β¬οΈ array sort function with a lambda of two params. Now we provide an api not available until spark 3.4 (only available through sql expressions).
- [feat] β¬οΈ array sort function with a lambda of one param. I have to thank @alfonsorr for this one, as it is his own idea, implementation. This functions is not available in any version of spark (yet).
- [fix] π³π£ !BREAKING_CHANGE: β οΈ filterWIndex from now on will be only available for spark 3.0+ (we have being testing this function only for spark 3.0+ and the filter function for spark 2.4 does not allow a lambda with 2 variables, so it would fail)
- [fix] π³ exists array function have being tested only for spark 3.0+, but it is available for all spark versions. Now it will be tested for all versions
- [test] β»οΈ createLambda functions have being copied/pasted from spark code in order to test some lambda functions available in doric but not available in older versions of spark api
Please, check there is no other feature request like this one to avoid duplicates: see doric issues
Expected Behavior
Currently, there is no spark api function to order an array of structs using other columns or a custom order function, is is necessary to create an expression to do so. It would be nice to have the following functions:
Current Behavior (if so)
Use the default ordering function or create an expression
The text was updated successfully, but these errors were encountered: