Refactor GC related PD APIs

[MyonKeminta]

Development Task

This is the majority part of the refactoring task pingcap/tidb#58720.

A set of new APIs for GC will be implemented which is expected to provide a more comprehensible semantics and recude potential misuses. This will also be the basis for implementing a planned feature name protected snapshots.

Subtasks

Note that protected snapshots won't be included in this phase and will be another separated work after finishing the refactoring.

• Add new RPC calls to kvproto Add new GC API pingcap/kvproto#1288
• Expose the if-then-else transaction interface of etcd to kv.Base layer, parallel to the existing kv.Base.RunInTxn. storage: expose etcd's transaction as LowLevelTxn interface to kv.Base #9016
• Add implementation new RPC interfaces. (may need to further breakdown into muitiple subtasks later)
  • Basic API set.
    • Including:
      • AdvanceGCSafePoint
      • AdvanceTxnSafePoint
      • SetGCBarrier
      • DeleteGCBarrier
      • GetGCState
      • GetGlobalGCState
    • storage/endpoint layer storage/endpoint: Add a new component GCStateStorage and GCStateProvider to storage/endpoints as the new storage layer for GC related metadata #9109
    • GCStateManager layer
      • gc: Add GCStateManager which is planned to be the replacement of SafePointManager #9169
      • gc: Implement compatibility methods and GetAllKeyspacesGCStates method to GCStateManager #9134
    • gRPC layer server: Add gRPC interfaces for the new GC APIs. #9189
  • Global GC barriers support gc: global GC barriers support #9340
    • kvproto: add global gc barrier API for pd pingcap/kvproto#1315
  • Support controlling disabling physical GC operations on TiKV (required by BR, lower priority)
  • Support watching global GC state changes (including all keyspaces; maybe required by keyspace-level-GC for running GC in TiKV, lower priority, necessary when the amount of keyspaces in a single cluster grows too high)
• Implement the new set of methods on pd.Client interface type.
  • Basic API set client: Update PD Client interface and supports the new GC API #9203
  • Global GC barriers support *: expose SetGlobalGCBarrier/DeleteGlobalGCBarrier API for pd client #9361
  • Support controlling disabling physical GC operations on TiKV (lower priority)
• New pd-ctl commands gc-state for replacing the current service-gc-safepoint command.
• Mark the old API deprecated. server, client: Deprecate old GC related APIs #9292
• Make keyspace level GC enabled by default
  • (Next gen only) keyspace: set GCManagementType default value to KeyspaceLevelGC for NextGen #9399

Other fixes and improvements:

• gc: make GetAllKeyspacesGCStates() ignore non-active keyspaces #9250
• client: Add a helper function for determining whether a keyspace has keyspace level GC enabled #9429
• Use typed error in PD client for callers to determine the error reason
• gc_state_manager: Make GetAllKeyspacesGCStates able to batch and reuse results for better performance when called frequently #9734