Add Dynamic Config Service to Core Service

[huyaboo]

Description

This PR adds a DynamicConfigService to core, enabling a subset of configs to be dynamically determined at request time. See #7111 for detailed design. By default, the feature is "disabled", meaning that when calling client.getConfig(...), the dynamicConfigService will return the static config in opensearch_dashboards.yml. The service will still exist as part of core

TODO

There are several TODO items outside the scope of this PR:

• Register routes to make the client accessible to the service (this PR will not affect configs since the client will default to yml configs
• Limit configs that are exposeToBrowser
• Validation logic when creating configs
• Determine logic for clearing the cache. Right now, the cache will not be deleted
• Add migration logic to deprecations, much like how saved objects are migrated

Issues Resolved

Partially addresses #7111

Screenshot

The below recording shows csp.rules being added as a document in the config store index .opensearch_dashboards_config (alias for .opensearch_dashboards_config_1). The site will intentionally break when the csp.rules is set to default-src 'none'.

Screen.Recording.2024-07-08.at.2.36.38.PM.mov

Note: in the recording, I had routes registered to add routes. This is PoC code and is not included in this PR. This is to help demonstrate changes using the OpenSearch client.

Testing the changes

Changelog

• feat: Add DynamicConfigService as a new Core service

Check List

• All tests pass
  • yarn test:jest
  • yarn test:jest_integration
• New functionality includes testing.
• New functionality has been documented.
• Update CHANGELOG.md
• Commits are signed per the DCO using --signoff

[github-actions]

❌ Empty Changelog Section

The Changelog section in your PR description is empty. Please add a valid changelog entry or entries. If you did add a changelog entry, check to make sure that it was not accidentally included inside the comment block in the Changelog section.

[codecov]

Codecov Report

Attention: Patch coverage is 72.14286% with 78 lines in your changes missing coverage. Please review.

Project coverage is 64.19%. Comparing base (a5c3dc2) to head (a473473).
Report is 7 commits behind head on main.

Files	Patch %	Lines
src/core/server/config/dynamic_config_service.ts	57.14%	19 Missing and 5 partials ⚠️
...server/config/service/configuration_client.mock.ts	42.30%	15 Missing ⚠️
...g/service/internal_dynamic_configuration_client.ts	71.42%	7 Missing and 3 partials ⚠️
src/core/server/config/utils/utils.ts	62.96%	10 Missing ⚠️
...e/config_store_client/dummy_config_store_client.ts	0.00%	7 Missing ⚠️
src/core/server/core_route_handler_context.ts	20.00%	4 Missing ⚠️
...ver/config/service/dynamic_configuration_client.ts	25.00%	3 Missing ⚠️
...ig_store_client/opensearch_config_store_factory.ts	0.00%	2 Missing ⚠️
.../core/server/config/dynamic_config_service.mock.ts	94.44%	0 Missing and 1 partial ⚠️
...fig_store_client/opensearch_config_store_client.ts	98.70%	0 Missing and 1 partial ⚠️
... and 1 more

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #7194      +/-   ##
==========================================
+ Coverage   63.83%   64.19%   +0.36%     
==========================================
  Files        3661     3671      +10     
  Lines       81343    81072     -271     
  Branches    12978    12898      -80     
==========================================
+ Hits        51924    52044     +120     
+ Misses      26234    25838     -396     
- Partials     3185     3190       +5     

Flag	Coverage Δ
Linux_1	30.22% <12.04%> (+0.07%)	⬆️
Linux_2	56.05% <70.60%> (+0.17%)	⬆️
Linux_3	40.52% <14.18%> (+0.13%)	⬆️
Linux_4	31.35% <12.04%> (+0.01%)	⬆️
Windows_1	30.23% <12.04%> (+0.07%)	⬆️
Windows_2	56.00% <70.60%> (+0.17%)	⬆️
Windows_3	40.52% <14.18%> (+0.13%)	⬆️
Windows_4	31.35% <12.04%> (+0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[github-actions]

❌ Empty Changelog Section

The Changelog section in your PR description is empty. Please add a valid changelog entry or entries. If you did add a changelog entry, check to make sure that it was not accidentally included inside the comment block in the Changelog section.

[SuZhou-Joe]

#7911 The latest artifact of OSD is not able to run, could we mitigate it?