[Feature-13429][Remote Logging] Add support for writing task logs to Google Cloud Storage

[rickchengx]

Purpose of the pull request

• close: [Feature][Remote Logging] Add support for writing task logs to Google Cloud Storage #13429
• A sub-task of [DSIP-18][Remote Logging] Add support for writing task logs to remote storage #13017

Brief change log

• Add support for writing task logs to Google Cloud Storage
• Fix the log path bug since the log full path has changed in Use MDC to filter task instance log #13673

Verify this pull request

manually test and UT

1. run a shell task

2. check log file on GCS

[codecov-commenter]

Codecov Report

Merging #13777 (cd1d55f) into dev (9df89cf) will decrease coverage by 0.07%.
The diff coverage is 6.34%.

❗ Current head cd1d55f differs from pull request most recent head 37fbae2. Consider uploading reports for the commit 37fbae2 to get more accurate results

@@             Coverage Diff              @@
##                dev   #13777      +/-   ##
============================================
- Coverage     39.09%   39.03%   -0.07%     
- Complexity     4434     4438       +4     
============================================
  Files          1142     1143       +1     
  Lines         42007    42065      +58     
  Branches       4740     4739       -1     
============================================
- Hits          16424    16421       -3     
- Misses        23783    23847      +64     
+ Partials       1800     1797       -3     

Impacted Files	Coverage Δ
...e/dolphinscheduler/common/constants/Constants.java	75.00% <ø> (ø)
...heduler/common/log/remote/GcsRemoteLogHandler.java	0.00% <0.00%> (ø)
...ler/common/log/remote/RemoteLogHandlerFactory.java	0.00% <0.00%> (ø)
...apache/dolphinscheduler/common/utils/LogUtils.java	1.40% <0.00%> (+1.40%)	⬆️
...hinscheduler/common/log/remote/RemoteLogUtils.java	25.00% <100.00%> (+4.31%)	⬆️

... and 2 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

[caishunfeng]

Hi @rickchengx please check the fail CI case.

[rickchengx]

Hi @rickchengx please check the fail CI case.

Hi, @caishunfeng , thanks a lot for your comment. I've update the pom

[sonarcloud]

SonarCloud Quality Gate failed.   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
1 Code Smell

3.9% Coverage
0.0% Duplication

[rickchengx]

Hi, @caishunfeng , could you please help review this again?

[caishunfeng]

LGTM