You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Inside eval method of OnEach function we would need to get value of provided ref (list/map/struct/array), then iterate through it and convert each element to row, then execute provided scalar function on it and then convert it back to with Row::toArray().
When provided ref does not points to array like structure, it should return null.
Apache spark also provides similar function, however they called it transform:
As explained on Discrod we are missing a function that could apply other function on each element of intput array.
Example:
Input List
Function:
Inside eval method of OnEach function we would need to get value of provided ref (list/map/struct/array), then iterate through it and convert each element to row, then execute provided scalar function on it and then convert it back to with Row::toArray().
When provided ref does not points to array like structure, it should return null.
Apache spark also provides similar function, however they called it transform:
https://spark.apache.org/docs/latest/api/scala/org/apache/spark/sql/functions$.html
The text was updated successfully, but these errors were encountered: