fix: Corrected Spark defaults to fix read/write functionality from Spark

[jn1119]

Issue #, if available: Issue 496 and Issue 495

Description of changes: See Issue 496 and Issue 495 for details.

• Removing is.hail.io.compress.BGzipCodec since Hail isn't setup correctly
• For Parquet- the main issue was parquet block size config which was defaulted to 1 TB and therefore was failing file writing. I have changed block size and other defaults to same as what Spark uses internally

Testing

• Deployed the change, imported the new SC template and provisioned EMR. Verified that read/write functionality and parquet writes specifically now work. Also verified that defaults are now updated correctly.

Checklist:

• Have you successfully deployed to an AWS account with your changes?
• Have you written new tests for your core changes, as applicable?
• Have you successfully tested with your changes locally?
• If new dependencies have been added, have they been pinned to specific versions?
• Is this change also required on the AWS Solution version?
• Have you updated openapi.yaml if you made updates to API definition (including add, delete or update parameter and request data schema)?
• If you had to run manual tests, have you considered automating those tests by adding them to end-to-end tests?

AS review ticket id:

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[codecov]

Codecov Report

Merging #526 (4fa845a) into develop (ea2650f) will increase coverage by 0.03%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           develop     #526      +/-   ##
===========================================
+ Coverage    49.01%   49.04%   +0.03%     
===========================================
  Files          243      243              
  Lines        12597    12503      -94     
  Branches      2032     2012      -20     
===========================================
- Hits          6174     6132      -42     
+ Misses        5606     5564      -42     
+ Partials       817      807      -10     

Impacted Files	Coverage Δ
src/models/aws-accounts/AwsAccountsStore.js	54.54% <0.00%> (-13.93%)	⬇️
src/models/aws-accounts/AwsAccount.js	16.66% <0.00%> (-1.86%)	⬇️
src/helpers/api.js	0.96% <0.00%> (+0.15%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ea2650f...4fa845a. Read the comment docs.