Shuffle split SegmentFault issue on complex type Array, exposed from customer Case

[zhixingheyi-tian]

From customer query, encountered SegmentFault issue.

Backtrace the core dump file:

#6  <signal handler called>
#7  0x00007f8623a13b00 in arrow::Status sparkcolumnarplugin::shuffle::Splitter::AppendList<arrow::ListType, arrow::StringType, arrow::ListArray, arrow::ListBuilder>(std::shared_ptr<arrow::ListArray> const&, std::vector<std::shared_ptr<arrow::ListBuilder>, std::allocator<std::shared_ptr<arrow::ListBuilder> > > const&, long) ()
   from /tmp/spark_columnar_plugin_5046574679083750592/libspark_columnar_jni.so
#8  0x00007f86239fb863 in sparkcolumnarplugin::shuffle::Splitter::SplitListArray(arrow::RecordBatch const&) ()
   from /tmp/spark_columnar_plugin_5046574679083750592/libspark_columnar_jni.so
#9  0x00007f8623a004be in sparkcolumnarplugin::shuffle::Splitter::DoSplit(arrow::RecordBatch const&) ()
   from /tmp/spark_columnar_plugin_5046574679083750592/libspark_columnar_jni.so
#10 0x00007f8623a005f8 in sparkcolumnarplugin::shuffle::Splitter::Split(arrow::RecordBatch const&) ()
   from /tmp/spark_columnar_plugin_5046574679083750592/libspark_columnar_jni.so
#11 0x00007f86236032cf in Java_com_intel_oap_vectorized_ShuffleSplitterJniWrapper_split ()
   from /tmp/spark_columnar_plugin_5046574679083750592/libspark_columnar_jni.so

The input recordbatch is：

in->ToString():col_76332#224:   [
    9047,
    5935
  ]
room_id#220:   [
    311,
    4369
  ]
col_52318#221:   [
    "drmyeitlkt",
    "fjtgvacknt"
  ]
col_3859#234:   [
    5131,
    1329
  ]
os#235:   [
    "tkwgprkbyg",
    "nirdfoawle"
  ]
col_94460#236:   [
    "pdyxckpsdm",
    "oufaqcojnx"
  ]
col_41078#237:   [
    "dihhuzhyco",
    "texdmhhvwb"
  ]
col_37774#238:   [
    "ljldmzkdup",
    "dljsjthjni"
  ]
col_13272#252:   [
    [
      "quphxbgjyx",
      "josfcmuiir",
      "opcomsjqar",
      "fhfdbchyrv",
      "jbzegbnwfj"
    ],
    [
      "rflhvnmymh",
      "izsranbqoz",
      "spjfaqxelp",
      "dswtpjyalm",
      "kwgjhehiya"
    ]
  ]
col_70363#245:   [
    "kfsbezwevo",
    "baglyleljo"
  ]
col_74054#246:   [
    1598803200,
    1598803200
  ]
col_68298#247:   [
    "nzlykrdytv",
    "ozqhtoeknb"
  ]
col_52825#248:   [
    5405,
    4442
  ]
col_84617#254:   [
    3885,
    4635
  ]
col_18854#257:   [
    693,
    807
  ]
col_7492#331:   [
    9409,
    9519
  ]
col_55231#332:   [
    -1598851795,
    -1598852758
  ]
live_id#267:   [
    10,
    10
  ]
app_id#258:   [
    3541,
    9600
  ]

[zhixingheyi-tian]

cc @zhouyuan @zhztheplayer

[zhouyuan]

close in #623