Issues

• llm-routing: expose a common hardware-aware recipe catalog

  NVIDIA/nvcf#2337 · Filter by author priyaselvaganesan opened on Oct 7, 2026

• llm-routing: separate shared infrastructure and independent model recipes

  NVIDIA/nvcf#2336 · Filter by author priyaselvaganesan opened on Oct 7, 2026

• llm-routing: preflight and download Jobs cannot be rerun after a failure

  bugllm-stackneeds-triage
  NVIDIA/nvcf#2335 · Filter by author kristinapathak opened on Oct 6, 2026

• llm-routing: runtime guard exits after start when the cgroup swap file is missing

  bugllm-stackneeds-triage
  NVIDIA/nvcf#2334 · Filter by author kristinapathak opened on Oct 6, 2026

• llm-routing: an interrupted model download resume can fail permanently and leave an oversized partial file

  bugllm-stackneeds-triage
  NVIDIA/nvcf#2333 · Filter by author kristinapathak opened on Oct 6, 2026

• llm-gateway-stack: demo UI key check passes when the gateway uses an external API-key Secret

  bugllm-stackneeds-triage
  NVIDIA/nvcf#2332 · Filter by author kristinapathak opened on Oct 6, 2026

• llm-routing: run model recipes on any ARM64 GPU cluster, including single-node GB300

  enhancementllm-stack
  NVIDIA/nvcf#2330 · Filter by author kristinapathak opened on Oct 6, 2026
  

• vanity-gateway: distinguish gateway-origin errors from upstream passthrough errors in metrics

  enhancementinvocation-plane
  NVIDIA/nvcf#2327 · Filter by author FamousDirector opened on Oct 6, 2026

• Add optional monitoring for the LLM routing demo

  NVIDIA/nvcf#2324 · Filter by author priyaselvaganesan opened on Oct 6, 2026

• nvca: shared-claim writer Job with repeated FailedCreate and no active pod is never bounded

  NVIDIA/nvcf#2323 · Filter by author balajinvda opened on Oct 6, 2026
  2

• Scope the OpenBao init-cluster Job Secret RBAC to the Secrets it manages

  NVIDIA/nvcf#2316 · Filter by author sunilthorat09 opened on Oct 6, 2026

• fix(pylon): canary flags capped reasoning responses as runaway generation

  NVIDIA/nvcf#2314 · Filter by author FamousDirector opened on Oct 6, 2026
  

• OpenBao init Job fails: manual raft join conflicts with retry_join and cannot recover on retry

  NVIDIA/nvcf#2313 · Filter by author sunilthorat09 opened on Oct 6, 2026

• Support auto-unseal (KMS/HSM seals) in the self-managed OpenBao chart

  NVIDIA/nvcf#2309 · Filter by author sunilthorat09 opened on Oct 6, 2026

• Exclude inline base64 from Chat Completions and Messages admission estimates

  NVIDIA/nvcf#2303 · Filter by author coderabbitai opened on Oct 6, 2026
  

• nvsnap: import the GPU shared-memory checkpoint library for multi-GPU checkpoint/restore

  enhancementnvsnap
  NVIDIA/nvcf#2299 · Filter by author balajinvda opened on Oct 6, 2026

• Document a three-Spark Kubernetes cluster setup

  NVIDIA/nvcf#2298 · Filter by author priyaselvaganesan opened on Oct 6, 2026

• Pylon fallback input TPS counts cached prompt tokens as prefill throughput

  NVIDIA/nvcf#2294 · Filter by author barrygreengus opened on Oct 5, 2026
  1

• modelUpdates silently ignores llmConfig.uris and llmConfig.tokenizer

  NVIDIA/nvcf#2291 · Filter by author Max-NV opened on Oct 5, 2026

• feat(stargate,llm-api-gateway): route returning sessions to their last cluster in wait-and-widen and pulsar-wait-and-widen

  NVIDIA/nvcf#2289 · Filter by author barrygreengus opened on Oct 5, 2026

• pulsar-wait-and-widen: wait for affinity and widen gradually with an overflow guard

  NVIDIA/nvcf#2287 · Filter by author barrygreengus opened on Oct 5, 2026

• MockDynamo: model batched multi-GPU Dynamo deployments

  NVIDIA/nvcf#2285 · Filter by author barrygreengus opened on Oct 5, 2026

• fix(stargate): expire in-flight routing reservations after one backend RTT instead of on Pylon updates

  NVIDIA/nvcf#2284 · Filter by author barrygreengus opened on Oct 5, 2026
  1

• nvca-operator: transient RBAC failure on first allowedExtraKubernetesTypes entry stalls agent rollout

  NVIDIA/nvcf#2282 · Filter by author apartha-nv opened on Oct 5, 2026

• grpc-proxy: MaxConcurrentStreams=MaxInt32 disables Go's HTTP/2 rapid-reset protection

  NVIDIA/nvcf#2280 · Filter by author sunilthorat09 opened on Oct 5, 2026
  1