koord-scheduler: fix Coscheduling resource deadlock with groups

[KunWuLuan]

Ⅰ. Describe what this PR does

fix: deadlock when schedule multi-gang-group

Ⅱ. Does this pull request fix one issue?

fixes #872

Ⅲ. Describe how to verify it

Ⅳ. Special notes for reviews

V. Checklist

• I have written necessary docs and comments
• I have added necessary unit tests and integration tests
• All checks passed in make test

[eahydra]

Thanks for your contribution. Please fix the unit-tests, and add signed off in git commit.

[codecov]

Codecov Report

Base: 67.52% // Head: 66.85% // Decreases project coverage by -0.66% ⚠️

Coverage data is based on head (e3db841) compared to base (f321a92).
Patch coverage: 51.95% of modified lines in pull request are covered.

❗ Current head e3db841 differs from pull request most recent head 5596bd6. Consider uploading reports for the commit 5596bd6 to get more accurate results

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #873      +/-   ##
==========================================
- Coverage   67.52%   66.85%   -0.67%     
==========================================
  Files         225      234       +9     
  Lines       25631    26919    +1288     
==========================================
+ Hits        17307    17998     +691     
- Misses       7121     7644     +523     
- Partials     1203     1277      +74     

Flag	Coverage Δ
unittests	66.85% <51.95%> (-0.67%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
pkg/koordlet/executor/resctrl_executor.go	0.00% <ø> (ø)
pkg/koordlet/executor/resource_update_executor.go	29.57% <ø> (ø)
pkg/koordlet/executor/types.go	31.48% <ø> (ø)
pkg/koordlet/metrics/psi.go	93.61% <ø> (ø)
pkg/koordlet/metricsadvisor/collector_gpu_linux.go	36.84% <ø> (ø)
...dlet/metricsadvisor/performance_collector_linux.go	69.56% <ø> (ø)
pkg/koordlet/resmanager/resmanager.go	54.33% <ø> (ø)
pkg/koordlet/runtimehooks/config.go	100.00% <ø> (ø)
...runtimehooks/hooks/batchresource/batch_resource.go	69.91% <ø> (ø)
pkg/koordlet/runtimehooks/hooks/cpuset/cpuset.go	90.58% <ø> (ø)
... and 100 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

[FillZpp]

/milestone v1.2

[eahydra]

/lgtm

[jasonliu747]

@KunWuLuan Hi, thanks for your hard work. Please fix the CI, then we're all set.

[eahydra]

/lgtm

[eahydra]

/lgtm
/approve

[koordinator-bot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: eahydra

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

• pkg/scheduler/OWNERS [eahydra]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment