Add shims for Spark 3.4.0

[firestarman]

This PR is to add shims for Spark 3.4.0.

It has mainly

• created the necessary classes for the 340 spark shims, Rapids shuffle manager and service provider.
• created shims for Parquet reading related changes, whose names starting with Parquet.
• created a new class ShimFilePartitionReaderFactory being the parent of the Rapids PERFILE readers, to hide the changes in Spark 3.4.0.
• added 340 to the build scripts.
• fixed some build errors by adding shims.

closes #5128
closes #5495

Signed-off-by: Firestarman firestarmanllc@gmail.com

[firestarman]

For early review.
It is draft becuase I am figuring out the failing ITs, will file the follow-up issues accordingly.
[Updated] The failing ITs are tracked by #5480.

And there are 21 unit tests failing, also failing on 330, tracked by #5457.

AnsiCastOpSuite:
- Write bytes to string *** FAILED ***
- Write shorts to string *** FAILED ***
- Write ints to string *** FAILED ***
- Write longs to string *** FAILED ***
- Write ints to long *** FAILED ***
- Write longs to int (values within range) *** FAILED ***
- Write longs to short (values within range) *** FAILED ***
- Write longs to byte (values within range) *** FAILED ***
- Write ints to short (values within range) *** FAILED ***
- Write ints to byte (values within range) *** FAILED ***
- Write shorts to byte (values within range) *** FAILED ***
- Write floats to long (values within range) *** FAILED ***
- Write floats to int (values within range) *** FAILED ***
- Write floats to short (values within range) *** FAILED ***
- Write floats to byte (values within range) *** FAILED ***
- Write doubles to long (values within range) *** FAILED ***
- Write doubles to int (values within range) *** FAILED ***
- Write doubles to short (values within range) *** FAILED ***
- Write doubles to byte (values within range) *** FAILED ***
- Copy ints to long *** FAILED ***
- Copy long to float *** FAILED ***

[firestarman]

PR is blocked by #5457. Keep draft

[firestarman]

A follow-up issue #5495

[firestarman]

build

[firestarman]

CI failed, since the premerge build requires updates accordingly. Waiting for 22.08.

[firestarman]

A new follow-up #5589

[firestarman]

build

[firestarman]

build

[firestarman]

build

[jlowe]

There should be tests on 340+ to verify we're properly falling back on the limit-with-offset scenarios, as it's silent data corruption if we don't get that correct.

[firestarman]

Added tests for it

[firestarman]

build