[fix][broker] Allow broker to handle non-recoverable schema error only if SchemaLedgerForceRecovery flag is enabled

[rdhabalia]

Motivation

We have made broker resilient during non-recoverable schema error with PR: #23395
However, there is discussion to make it only if SchemaLedgerForceRecovery enabled. so, this PR enables schema lost recovery only if force flag is enabled.

Verifying this change

• Make sure that the change passes the CI checks.

(Please pick either of the following options)

This change is a trivial rework / code cleanup without any test coverage.

(or)

This change is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(example:)

• Added integration tests for end-to-end deployment with large payloads (10MB)
• Extended integration test for recovery after broker failure

Does this pull request potentially affect one of the following parts:

If the box was checked, please highlight the changes

• Dependencies (add or upgrade a dependency)
• The public API
• The schema
• The default values of configurations
• The threading model
• The binary protocol
• The REST endpoints
• The admin CLI options
• The metrics
• Anything that affects deployment

Documentation

• doc
• doc-required
• doc-not-needed
• doc-complete

Matching PR in forked repository

PR in forked repository:

[github-actions]

@rdhabalia Please add the following content to your PR description and select a checkbox:

- [ ] `doc` <!-- Your PR contains doc changes -->
- [ ] `doc-required` <!-- Your PR changes impact docs and you will update later -->
- [ ] `doc-not-needed` <!-- Your PR changes do not impact docs -->
- [ ] `doc-complete` <!-- Docs have been already added -->

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 0% with 2 lines in your changes missing coverage. Please review.

Project coverage is 74.31%. Comparing base (bbc6224) to head (d0b64de).
Report is 661 commits behind head on master.

Files with missing lines	Patch %	Lines
...rg/apache/pulsar/broker/service/AbstractTopic.java	0.00%	0 Missing and 2 partials ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##             master   #23428      +/-   ##
============================================
+ Coverage     73.57%   74.31%   +0.74%     
- Complexity    32624    34447    +1823     
============================================
  Files          1877     1950      +73     
  Lines        139502   147718    +8216     
  Branches      15299    16402    +1103     
============================================
+ Hits         102638   109782    +7144     
- Misses        28908    29449     +541     
- Partials       7956     8487     +531     

Flag	Coverage Δ
inttests	27.69% <0.00%> (+3.11%)	⬆️
systests	24.39% <0.00%> (+0.07%)	⬆️
unittests	73.65% <0.00%> (+0.81%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines	Coverage Δ
...rg/apache/pulsar/broker/service/AbstractTopic.java	87.91% <0.00%> (-0.08%)	⬇️

... and 628 files with indirect coverage changes

[lhotari]

LGTM, thanks for the great improvements, @rdhabalia

[lhotari]

Closed and reopened to get Pulsar CI to run with fix PR #23431