Skip to content

Request for review: semantic admission/APF evaluation harness #4014

@minustwo

Description

@minustwo

Hello Kubernetes perf-tests / SIG Scalability maintainers,

This is a request for review of a third-party evaluation harness for a semantic consistency kernel called MST-NF. It is intentionally framed as a benchmark-mapping and artifact-review request, not as an upstream merge request.

Public artifact:

Boundary statement:

This is not a benchmark of Kubernetes production core. It is not kube-apiserver production core, not scheduler production core, not etcd behavior, not a real admission webhook, and not a real cluster workload benchmark. It does not invoke kube-apiserver admission, scheduler, kubelet, etcd, webhook, container runtime, or production Kubernetes control-plane paths. The Sonobuoy wrapper uses Kubernetes only as a standard test carrier.

The artifact tests high-concurrency Kubernetes-style admission traffic over this canonical lane:

namespace:resourceClass:timeWindow

The current artifact checks:

  • useful admissions are preserved
  • backend attempts are reduced
  • CAS conflicts, retries, duplicate backend attempts, and priority inversions are eliminated in the MST-NF treatment
  • replay divergence is zero
  • seed-sweep invariant failures are empty
  • Kubernetes-style AdmissionReview projection is present
  • Kubernetes-style ResourceQuota projection is present
  • Kubernetes APF-style FlowSchema and PriorityLevelConfiguration projections are present
  • APF-style flow classification, queue-key projection, fair-queue shape, and response-header shape are checked
  • priority/preemption fixture passes
  • APF-style priority isolation fixture passes
  • Sonobuoy Job plugin wrapper is available for Kubernetes-cluster-carried reproduction

Reviewer commands:

npm run verify
npm run sonobuoy:smoke

The Sonobuoy wrapper can also be built and run from the artifact directory:

docker build -f sonobuoy/Dockerfile -t mstnf-k8s-admission-sonobuoy:local .
sonobuoy run \
  --plugin sonobuoy/mstnf-k8s-admission-plugin.yaml \
  --plugin-image mstnf-k8s-admission=mstnf-k8s-admission-sonobuoy:local \
  --wait

Key docs in the artifact:

  • BENCHMARK_NOTES.md
  • docs/EXTERNAL_K8S_SOURCE_MAP.md
  • docs/ACCEPTANCE_CRITERIA.md
  • docs/REPRODUCIBILITY.md
  • docs/THIRD_PARTY_REVIEW.md
  • sonobuoy/README.md

Requested feedback:

  • Is this a fair Kubernetes-adjacent evaluation mapping for admission/quota/APF-style traffic?
  • Are the AdmissionReview and ResourceQuota projections useful external anchors?
  • Is the APF FlowSchema / PriorityLevelConfiguration projection useful for reviewing priority isolation and fair-queue classification?
  • Are the priority/preemption and APF fixtures fair enough for an admission-control benchmark?
  • Would a ClusterLoader2-compatible wrapper be the right next step if this were to move closer to kubernetes/perf-tests conventions?
  • Are the boundary clauses clear enough to avoid confusion with production Kubernetes core benchmarking?

Thank you for any guidance on whether this artifact belongs near perf-tests, should stay as an external artifact, or should be reshaped before further review.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions