update proxy of master to raftstore-proxy

[CalvinNeo]

What problem does this PR solve?

Issue Number: ref #4982

Problem Summary:
update proxy to raftstore-proxy
Proxy PR:
Including:\nSubmodule contrib/tiflash-proxy 549464ebb3..ed635da202 (rewind):
< Merge remote-tracking branch 'tikv/master' into merge-master-beyond-8.4
< adapt for tests
< Merge remote-tracking branch 'tikv/master' into merge-master-beyond-8.4
< Compaction for FAP serverless including txn file ref, shard_ver and enc key (#397)
< ci: udpate OWNERS_ALIASES file (#396)
< Support only set prof.active (#393)
< Support debug/pprof/symbol call to enable remote jeprof (#392)
< Add some test about replica read (#390)
< Handle MsgSnapshot sent before MsgAppend (#389)
< Fix build on macos (#388)
< Fix the compile issue on arm64 (#387)
< Enable /debug/pprof/heap (#384)
< Fix some warnings and errors on mac (#383)
< Disable enable_heap_profiling and improve some codes (#380)
< Skip proxy build time (#379)
< Merge pull request #377 from CalvinNeo/upd-redact-log
< Enable heap profiling (#376)
< Fix slog and slog-global (#375)
< Merge pull request #374 from CalvinNeo/upgrade-near-8.2
< Add approvers (#373)
< Strengthen configuration change approval (#371)
< Add log for current ReadIndex mechanism (#370)
< Add some tests for replica read (#369)
< Keep debug info (#368)
< Trace memory alloc/dealloc by thread (#366)
< Create ps_engine.raftlog if presents ps_engine (#367)
< Make FAP FFIs aware the index and term of an fap snapshot (#365)
< FFI: add two empty implement FFI for compatibility (#361)
< pick fn_get_lock_key (#364)
< Support cancel fap on TiFlash's side (#363)
< Merge pull request #362 from CalvinNeo/upgrade-to-near-7.6
< Introduce two phase FAP (#360)
< Enhance some FAP tests (#359)
< Fix proxy's readme (#358)
< Fix fn_get_config_json (#357)
< Provide split key in tablet reader (#355)
< Fix ci_check.sh for some tests (#356)
< Remove jemalloc in raftstore-proxy (#354)
< Retry when DNS resolution to TiKV status server fails (#353)
< Show enable-features in TiFlash (#352)
< Merge pull request #351 from CalvinNeo/merge-tikv-near-7.4
< Proactive Flush part1: New passive flush logic (#350)
< Longer wait time before TiKV bootstrap cluster (#349)
< Support release and abort prehandled snapshot (#348)
< Loop wait if TiKV store is not bootstrapped when detect raftstore version (#347)
< Merge pull request #346 from CalvinNeo/merge-tikv-7.3-0cb091d3c
< Replace the previous task if a new snapshot is coming (#344)
< Merge pull request #343 from CalvinNeo/merge-tikv-near-7.3-2
< Remove the copied raft log if the FAP process timeout (#342)
< Merge pull request #340 from CalvinNeo/merge-tikv-master-near-7.3
< Sort if meet multiple cf files in one round of handle_ingest_sst (#339)
< Add helper to examine SST file (#338)
< diagnostic: fix index out of bounds error in sysinfo (#333)
< Add debug utils for tablet snapshot (#331)
< Support replace url with a host string (#337)
< Use addr's ip if status_addr's is is empty (#334)
< Get raftstore version of cluster by requesting TiKV's status server (#332)
< support fetch server_info without starting Proxy (#330)
< Merge pull request #329 from CalvinNeo/v2/merge-7.1-freeze
< Accumulative fix for v2 compat (#328)
< Fix enable receive tablet snapshot (#327)
< Merge pull request #325 from CalvinNeo/v2/merge-7.1-1
< Fix ci_check script (#324)
< Support proxy tests of simple write (#323)
< Merge pull request #322 from CalvinNeo/update-7.1/merge-base
< Support read data from tablet snapshot (#321)
< Merge pull request #320 from CalvinNeo/update-7.1/fix-tikv
< Support fn_seek and fn_kind (#319)
< Merge pull request #318 from CalvinNeo/v2-update/merge-for-v2-snapshot
< Merge pull request #317 from CalvinNeo/v2-update/merge-for-v2-simplewrite
< Support using difference kind of SSTReader (#316)
< Fix panic when BaseBuffView::len == 0 (#314)
< Support common layer of server part2 (#313)
< Support common layer of server part1 (#312)
< Merge pull request #311 from CalvinNeo/update/7.0-2
< Use larger defaults for BR import (#309)
< Fix raft log gc failure (#310)
< Reorg some proxy's components into proxy_components (#308)
< Introduce test_raftstore_v2 (#305)
< Fix raft clean and gc on PSLogEngine (#307)
< Introduce mixed cluster (#303)
< Merge to TiKV 7.0(5a8f970d313a6) (#304)
< Move some test utils into mock-engine-store (#302)
< Use engine from FFI (#301)
< use mock_cluster::v1 in tests (#300)
< Move test_raftstore related code to mock_cluster::v1 (#299)
< add engine-role (#296)
< Fix PSEngine panic (#298)
< Support overwrite enable-unips from TiFlash (#297)
< Change raft engine key prefix (#291)
< Support mixed mode write batch and introduce enable-unips feature (#295)
< Introduce mix-mode engine (#288)
< update proxy of 7.0 to tikv master (f0af6ff1f5) (#286)
< Try more to decouple mock engine store (#282)
< Change kv engine key format (#287)
< Introduce PageStorageInterfaces (#285)
< rename and improve uni ps related ffi (#284)
< Split PS and RocksDB part of TiFlash (#281)
< Introduce proxy_ext, ps_engine, and cluster_ext (#280)
< No longer use FFIHub when calling FFI from engine_tiflash (#279)
< Refactor new-mock-engine-store (#278)
< Choose if we should use PSEngine (#277)
< Introduce proxy_ffi as a separated FFI layer (#276)
< Decouple FFI with TiFlashEngine (#275)
< Split RaftStoreProxy and RaftStoreProxyFFI (#273)
< Rename some structs of Proxy (#272)
< Integrate all ffi interfaces into a mod (#271)
< Decouple forward logic from Observers (#270)
< Merge uni ps and fast add peer into master (#269)
< Merge pull request #266 from CalvinNeo/merge-tikv-6.6-3
< Merge pull request #262 from CalvinNeo/merge-tikv-release-6.6-2
< patch backtrace-rs (#254)
< Change Config Value for TiFlash (#244)
< Merge pull request #249 from hongyunyan/hongyunyan-merge-tikv-master
< use eprintln before init logger (#247)
< Merge pull request #239 from CalvinNeo/fix-pprof-test
< Refactor engine_store_ffi/lib.rs (#235)
< Neat tests (#229)
< Merge 6.5 release(7a3764fcb) (#227)
< Merge tikv 6.5 release 0f1d45a8e6f (#226)
< set status-thread-pool-size to 2 by default (#224)
< A validation of prototype which we can restart without duplicate snapshot from raftstore leader (#222)
< Merge TiKV about 6.5(616b4402192) (#221)
< Add some tests to protect logics before and after cloud TiFlash (#220)
< Bump to TiKV about 6.5(e87d16d0b1) (#219)
< Polish tests (#218)
< Reorg some scripts and codes for neat code (#217)
< Introduce clippy to more modules (#215)
< Refactor some tests and enable clippy in engine_store_ffi (#214)
< Fix pprof unwind error on dwarf (#213)
< Recover feature for pprof-rs (#212)
< Fix failed make (#211)
< Depend TiKV as a Cargo component (#210)
< Depend all proxy's crates by workspace (#209)
< Remove abundant tests and configs (#208)
< support set engine-lable using command arguments (#182)
< Merge TiKV about 6.4(0f5058ebcc489bc28) (#206)
< Fix advertise status addr (#207)
< Add tests for Flashback and support adhoc persist (#205)
< Support write apply state observer (#204)
< Recover more TiKV codes (#203)
< Save pending_delete_ssts in TiFlashObserver to avoid potential leak of file (#202)
< Enable Multi SST Snapshot (#201)
< Merge TiKV about 6.4(b448214b8) (#194)
< Try to fix "Illegal Oprand" panic about ConcurrencyManager (#193)
< Fix unit test checking (#189)
< Revert "Remove heavy work on github actions (#183)" (#188)
< Simplify build scripts (#186)
< Remove heavy work on github actions (#183)
< Introduce ServerCluster test framework (#185)
< Merge to TiKV 6.3(b5329ee) into Proxy (#175)
< use a larger snap pool by default (#176)
< Fix proxy config (#174)
< Fix SST thread not taking effect (#173)
< Reclaim test_raftstore and remove mock-engine-store (#172)
< Use pre_persist to control persistence (#171)
< server: support customized addr/status_addr (#13234) (#170)
< Add fn_handle_safe_ts_update ffi (#169)
< encryption: fix issue with opening plaintext files (#12272) (#168)
< remove engine_store_ffi out of raftstore (#167)
< Support can_apply_snapshot (#166)
< Reject when we recv multi file snapshot (#165)
< Fix small bugs of ci (#163)
< Cherry pick sm4 encryption (#164)
< Workaround ci (#162)
< Use as less engine_rocks in engine_tiflash as we can (#156)
< Default enable raft-engine (#150)
< Add readme for proxy (#145)
< Reclaim TiKV's tikv_util crate (#154)
< raftstore: Increase default low-priority pool size
< Don't write to rockdb when meet empty write batch (#159)
< Decouple engine_store_ffi and raftstore (#157)
< Reclaim TiKV's component server and status server (#152)
< Remove engine store server helper in raftstore (#148)
< Decouple apply snapshot by introducing pre(post)_apply_snapshot (#146)
< Use proxy's own config checker (#153)
< Support post_exec on Raftstore Proxy (#140)
< Implement Proxy's own status_server (#141)
< Fix error parse of ProxyConfig (#144)
< Avoid set addr/engine-addr and HackedLockManager in src/node.rs (#139)
< Support pd task observer to compute store stats for TiFlash (#136)
< diagnostics: support cgroup limit memory (#13237) (#138)
< updating proxy 6.2 for 2 bugfixs (#137)
< Handle destroy peer by observer (#132)
< Re-enable debug service (#131)
< Fix RegionEpoch Error and CheckWaitIndex takes too long (#134)
< Pass index and term to pre_exec (#133)
< Fix commands are filtered without no post_exec to catch (#130)
< Migrate pre exec (#123)
< Support on_empty_cmd observer in Proxy (#121)
< Introduce proxy_server and new-mock-engine-store (#120)
< Introduce new FFIs: fn_need_flush_data and fn_try_flush_data (#119)
< introduce only-decription mode (#118)
< fix test merge failure
< disable some check
< fix mock-engine-store bugs
< introduce proxy_compat mode to run both old and new tests
< fix
< add observer
< move LockCFFileReader out
< disable useless codes
< migrate some tests from new proxy
< fmt
< fix typo
< migrate test part 1
< f
< fix tests
< test panick
< fix tests error
< address all errors
< fix some errors
< fix some erros
< Merge remote-tracking branch 'tikv/release-6.1' into merge-tikv-6.1-from-raftstore-proxy-6.1
< Merge pull request #75 from Lloyd-Pottiger/pick-cgroup
< Merge remote-tracking branch 'upstream/raftstore-proxy' into raftstore-proxy-6.1
< remove log
< Hotfix pprof (#65)
< Raftstore proxy 6.0 try (#63)
< fix
< fix pd.rs of reporting to PD
< Merge branch 'raftstore-proxy-6.0-try' of github.com:pingcap/tidb-engine-ext into raftstore-proxy-6.0-try
< raftstore:Fix append log entry oom (#12247)
< reduce log
< Merge remote-tracking branch 'upstream/raftstore-proxy-6.0-try' into raftstore-proxy-6.0-try
< pick pr 12301
< Merge remote-tracking branch 'tikv/release-6.0' into raftstore-proxy-6.0-try
< remove stale peer
< disable
< f
< disable more disk_full tests
< fix fmt
< ignore some unsupported tests
< fix
< fix
< fix some files
< fix
< fix linux
< f
< Fix test
< address test deps
< fix linux
< fmt
< it compiles
< before handle cdc
< remove exec_ctc
< use exec_log_index/term
< add except exec_ctx
< refine some versions
< Merge commit 'caf3514c7' into raftstore-proxy-6.0-try
< Cherry pick: raftstore: set term when catch up logs for merge
< Cherry pick: fix taking rootfs as filesystem by mistake (#11554) (#52)
< Update readme
< Add interfaces to get region local state (#51)
< rename proxy lib's install_name for darwin (#50)
< support async read-index-task Summary: timer (#43)
< Remove hypothesis that engine is tiflash (#47)
< Fix ci build cache error (#48)
< Update build.sh
< pprof: ignore cpu profiling on non-x86 arch (#45)

What is changed and how it works?

Check List

Tests

• Unit test
• Integration test
• Manual test (add detailed scripts or steps below)
• No code

Side effects

• Performance regression: Consumes more CPU
• Performance regression: Consumes more Memory
• Breaking backward compatibility

Documentation

• Affects user behaviors
• Contains syntax changes
• Contains variable changes
• Contains experimental features
• Changes MySQL compatibility

Release note

None

[ti-chi-bot]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from calvinneo, ensuring that each of them provides their approval before proceeding. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[CalvinNeo]

/close

[ti-chi-bot]

@CalvinNeo: Closed this PR.

In response to this:

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.