Refactor CI scripts to support more components

[yongfengdu]

Description

Refactor the CI scripts.

Issues

Closed #471

Type of change

List the type of change like below. Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds new functionality)
• Breaking change (fix or feature that would break existing design and interface)

Dependencies

List the newly introduced 3rd party dependency if exists.

Tests

Describe the tests that you ran to verify your changes.

[eero-t]

Few suggestions for the CI document.

[yongfengdu]

Check Path error is due to CI script error, I've double checked the link is valid.
Guardrails test failure is not related to this change, and need further debug.
Since this PR will trigger all CI tests for helm charts and consume quite a lot resource and will block other changes, let's merge this first and I'll provide a follow up fix for retriever-usvc and prompt-usvc and disable guardrails CI.

[lianhao]

Check Path error is due to CI script error, I've double checked the link is valid. Guardrails test failure is not related to this change, and need further debug. Since this PR will trigger all CI tests for helm charts and consume quite a lot resource and will block other changes, let's merge this first and I'll provide a follow up fix for retriever-usvc and prompt-usvc and disable guardrails CI.

fast approve this due to above reasons