XPU Periodic Run Auto Skip & Rerun #5490

Activity

1. torchxpubot

   added

   module: infraOnly for CICD infra used, no action needOnly for CICD infra used, no action need

   on Sep 22, 2026
2. torchxpubot

   pinned this issue on Sep 22, 2026
3. torchxpubot commented on Sep 23, 2026

   

   torchxpubot

   on Sep 23, 2026

   ContributorAuthor

   More actions

   Commit ef7af4063de3047e2b39938d53529e84058f0535 — xpu.yml run
   Test job(s) failed but no test cases could be parsed (possible timeout/infra); rerunning:

   • linux-noble-xpu-n-py3.10 / test (default, 10, 12, linux.idc.xpu): https://github.com/pytorch/pytorch/actions/runs/35763243846/job/106877707028
   • linux-noble-xpu-n-py3.10 / test (default, 9, 12, linux.idc.xpu): https://github.com/pytorch/pytorch/actions/runs/35763243846/job/106877707145
4. ZhaoqiongZ

   added 2 commits that reference this issue on Sep 23, 2026

   [bot] Point SOURCE at the report issue now that it lives here

   ...

   d2bc08d

   [bot] Turn the cron on

   ...

   67074f9
5. torchxpubot commented on Sep 23, 2026

   

   torchxpubot

   on Sep 23, 2026

   ContributorAuthor

   More actions

   Commit 1ceb4d6accf3cf701d04aefefe126e4ec64bccea — xpu.yml run
   Test job(s) failed but no test cases could be parsed (possible timeout/infra); rerunning:

   • linux-noble-xpu-n-py3.10 / test (default, 12, 12, linux.idc.xpu): https://github.com/pytorch/pytorch/actions/runs/35805235564/job/107011020432
6. torchxpubot commented on Sep 23, 2026

   

   torchxpubot

   on Sep 23, 2026

   ContributorAuthor

   More actions

   Commit 82e11efd09479cfbae9c03a174fa4714b09d1f89 — xpu.yml run
   21 test failures (>= threshold 5); cannot auto-disable. Failed cases:

   • TestSparseCSRXPU.test_addmm_dense_result_SparseCSC_xpu_complex64
   • TestSparseCSRXPU.test_addmm_dense_result_SparseCSC_xpu_float32
   • TestSparseCSRXPU.test_addmm_dense_result_SparseCSC_xpu_float64
   • TestSparseCSRXPU.test_addmm_dense_result_SparseCSR_xpu_complex128
   • TestSparseCSRXPU.test_sparse_mm_reduce_sum_xpu_bfloat16
   • TestSparseCSRXPU.test_sparse_mm_reduce_sum_xpu_float32
   • TestSparseCSRXPU.test_sparse_mm_reduce_sum_xpu_float64
   • TestSparseCSRXPU.test_sparse_mm_reduce_xpu_bfloat16
   • TestSparseCSRXPU.test_sparse_mm_reduce_xpu_float32
   • TestSparseCSRXPU.test_sparse_mm_reduce_xpu_float64
   • TestSparseCompressedTritonKernelsXPU.test_triton_bsr_softmax_xpu_float16
   • TestSparseCSRXPU.test_addmm_dense_result_SparseCSC_xpu_complex128
   • TestSparseCSRXPU.test_addmm_dense_result_SparseCSR_xpu_complex64
   • TestSparseCSRXPU.test_addmm_dense_result_SparseCSR_xpu_float32
   • TestSparseCSRXPU.test_addmm_dense_result_SparseCSR_xpu_float64
   • TestSparseCSRXPU.test_sparse_csr_unary_inplace_abs_xpu_complex64
   • TestSparseCSRXPU.test_sparse_csr_unary_out_abs_xpu_complex64
   • TestSparseCSRXPU.test_sparse_mm_reduce_sum_xpu_float16
   • TestSparseCSRXPU.test_sparse_mm_reduce_xpu_float16
   • TestSparseCompressedTritonKernelsXPU.test_triton_bsr_softmax_xpu_bfloat16
   • TestSparseCompressedTritonKernelsXPU.test_triton_bsr_softmax_xpu_float32

   cc @chuanqi129
7. ZhaoqiongZ

   added 2 commits that reference this issue on Sep 24, 2026

   [bot] Point SOURCE at the report issue now that it lives here

   ...

   7665e77

   [bot] Turn the cron on

   ...

   9a5a41f
8. torchxpubot commented on Sep 25, 2026

   

   torchxpubot

   on Sep 25, 2026

   ContributorAuthor

   More actions

   Commit a4fb5084b0f8fbdab739d43be57a95edd53cf645 — xpu.yml run
   Disable issues:

   • DISABLED test_package_keeps_a_loaded_device_a_recompile_does_not_name (__main__.TestPackage) pytorch/pytorch#197144
9. torchxpubot commented on Sep 25, 2026

   

   torchxpubot

   on Sep 25, 2026

   ContributorAuthor

   More actions

   Commit 3d2e3b9070bd8876114e51c6eda68d9d981c78c1 — xpu.yml run
   Disable issues:

   • DISABLED test_package_keeps_a_loaded_device_a_recompile_does_not_name (__main__.TestPackage) pytorch/pytorch#197144
10. torchxpubot commented on Sep 25, 2026

    

    torchxpubot

    on Sep 25, 2026

    ContributorAuthor

    More actions

    Commit d847aabe6a44f1e330f67f336357a17504916524 — xpu.yml run
    Disable issues:

    • DISABLED test_package_keeps_a_loaded_device_a_recompile_does_not_name (__main__.TestPackage) pytorch/pytorch#197144
11. torchxpubot commented on Sep 25, 2026

    

    torchxpubot

    on Sep 25, 2026

    ContributorAuthor

    More actions

    Commit 6d03f2608c11ac75af45b126b1b75590db3b4d22 — xpu.yml run
    Disable issues:

    • DISABLED test_package_keeps_a_loaded_device_a_recompile_does_not_name (__main__.TestPackage) pytorch/pytorch#197144
12. torchxpubot commented on Sep 25, 2026

    

    torchxpubot

    on Sep 25, 2026

    ContributorAuthor

    More actions

    Commit e36bd457ea6cdc9f927f60fb7b9a0fca59ce8bcc — xpu.yml run
    Disable issues:

    • DISABLED test_package_keeps_a_loaded_device_a_recompile_does_not_name (__main__.TestPackage) pytorch/pytorch#197144
13. torchxpubot commented on Sep 25, 2026

    

    torchxpubot

    on Sep 25, 2026

    ContributorAuthor

    More actions

    Commit 86e769413a5028fddfe4abf1a618ac0b20e5d4b7 — xpu.yml run
    Disable issues:

    • DISABLED test_package_keeps_a_loaded_device_a_recompile_does_not_name (__main__.TestPackage) pytorch/pytorch#197144
14. 541 remaining items

    Load more

    Load more actions

15. torchxpubot commented on Nov 11, 2026

    

    torchxpubot

    on Nov 11, 2026

    ContributorAuthor

    More actions

    Commit 9ea22e990e357a41b9e213563fb427e7fb1c6124 — xpu.yml run
    Test job(s) failed but no test cases could be parsed (possible timeout/infra); rerunning:

    • linux-noble-xpu-n-py3.11 / test (default, 4, 12, linux.idc.xpu): https://github.com/pytorch/pytorch/actions/runs/42922524687/job/130211983287
    • linux-noble-xpu-n-py3.11 / test (default, 11, 12, linux.idc.xpu): https://github.com/pytorch/pytorch/actions/runs/42922524687/job/130211983400
    • linux-noble-xpu-n-py3.11 / test (default, 12, 12, linux.idc.xpu): https://github.com/pytorch/pytorch/actions/runs/42922524687/job/130211983447
16. torchxpubot commented on Nov 11, 2026

    

    torchxpubot

    on Nov 11, 2026

    ContributorAuthor

    More actions

    Commit e231c7d8ada5ac7a7c72db99aeebb26c0c6215fd — xpu.yml run
    Test job(s) failed but no test cases could be parsed (possible timeout/infra); rerunning:

    • linux-noble-xpu-n-py3.11 / test (default, 4, 12, linux.idc.xpu): https://github.com/pytorch/pytorch/actions/runs/42933008818/job/130246761511
    • linux-noble-xpu-n-py3.11 / test (default, 11, 12, linux.idc.xpu): https://github.com/pytorch/pytorch/actions/runs/42933008818/job/130246761537
17. torchxpubot commented on Nov 11, 2026

    

    torchxpubot

    on Nov 11, 2026

    ContributorAuthor

    More actions

    Commit 16f95a999783c6d0bcd0fb81d07d6c78f30f9803 — xpu.yml run
    Test job(s) failed but no test cases could be parsed (possible timeout/infra); rerunning:

    • linux-noble-xpu-n-py3.11 / test (default, 4, 12, linux.idc.xpu): https://github.com/pytorch/pytorch/actions/runs/42889378044/job/130410006006
18. torchxpubot commented on Nov 11, 2026

    

    torchxpubot

    on Nov 11, 2026

    ContributorAuthor

    More actions

    Commit 0729d86c88f5af969d570a1af7a3ef22b018c8ed — xpu.yml run
    Test job(s) failed but no test cases could be parsed (possible timeout/infra); rerunning:

    • linux-noble-xpu-n-py3.11 / test (default, 12, 12, linux.idc.xpu): https://github.com/pytorch/pytorch/actions/runs/42913836320/job/130410083202
19. torchxpubot commented on Nov 11, 2026

    

    torchxpubot

    on Nov 11, 2026

    ContributorAuthor

    More actions

    Commit ae92b187d07dde586c2347b8cc8ad415195da0f3 — xpu.yml run
    Disable issues:

    • DISABLED test_partitioner_activation_memory_budget_with_unbacked_symints_xpu (__main__.ReproTestsDeviceXPU) pytorch/pytorch#203837
20. torchxpubot commented on Nov 11, 2026

    

    torchxpubot

    on Nov 11, 2026

    ContributorAuthor

    More actions

    Commit 9ea22e990e357a41b9e213563fb427e7fb1c6124 — xpu.yml run
    Test job(s) failed but no test cases could be parsed (possible timeout/infra); rerunning:

    • linux-noble-xpu-n-py3.11 / test (default, 11, 12, linux.idc.xpu): https://github.com/pytorch/pytorch/actions/runs/42922524687/job/130410229752
21. torchxpubot commented on Nov 11, 2026

    

    torchxpubot

    on Nov 11, 2026

    ContributorAuthor

    More actions

    Commit e231c7d8ada5ac7a7c72db99aeebb26c0c6215fd — xpu.yml run
    Test job(s) failed but no test cases could be parsed (possible timeout/infra); rerunning:

    • linux-noble-xpu-n-py3.11 / test (default, 11, 12, linux.idc.xpu): https://github.com/pytorch/pytorch/actions/runs/42933008818/job/130410293927
22. torchxpubot commented on Nov 12, 2026

    

    torchxpubot

    on Nov 12, 2026

    ContributorAuthor

    More actions

    Commit 97abd31a15968d1d07b744abf356c375f7b488aa — xpu.yml run
    Timeout detected: manual investigation required; no automatic rerun or disable.

    Failed jobs

    Job	Runner	Type	Cases / details
    test (default, 5, 12, linux.idc.xpu)	dut7902_pvc_card_0	timeout	Shard 5/12 · file shards passed 71/74 Timed out in inductor/test_compiled_optimizers 1/1 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) Timed out in inductor/test_kernel_configs 1/1 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) Timed out in test_foreach 1/1 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) No matching timeout test-report artifact available

    _{File shards = test-file shards (not job-matrix shards). Unknown/candidate timeout cases are not confirmed culprits.}

    cc @chuanqi129 @ZhaoqiongZ @CuiYifeng
23. torchxpubot commented on Nov 12, 2026

    

    torchxpubot

    on Nov 12, 2026

    ContributorAuthor

    More actions

    Commit 428a7524239fcfc275c6b380e78884dc6a3452ad — xpu.yml run
    Timeout detected: manual investigation required; no automatic rerun or disable.

    Failed jobs

    Job	Runner	Type	Cases / details
    test (default, 5, 12, linux.idc.xpu)	dut7361_pvc_card_2	timeout	Shard 5/12 · file shards passed 8/74 Timed out in functorch/test_ops 1/3 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) Timed out in inductor/test_aot_inductor 5/5 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) Timed out in inductor/test_compiled_optimizers 1/1 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) No matching timeout test-report artifact available
    test (default, 11, 12, linux.idc.xpu)	dut7364_pvc_card_7	timeout	Shard 11/12 · file shards passed 0/87 Timed out in custom_operator/test_infer_schema_annotation 1/1 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) Timed out in distributions/test_constraints 1/1 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) Timed out in dynamo/test_aot_compile 1/1 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) No matching timeout test-report artifact available

    _{File shards = test-file shards (not job-matrix shards). Unknown/candidate timeout cases are not confirmed culprits.}

    cc @chuanqi129 @ZhaoqiongZ @CuiYifeng
24. torchxpubot commented on Nov 12, 2026

    

    torchxpubot

    on Nov 12, 2026

    ContributorAuthor

    More actions

    Commit d06605a86a0ef725b75a8222206427a4061fab10 — xpu.yml run
    873 test failures (>= threshold 7); cannot auto-disable.
    Timeout detected: manual investigation required; no automatic rerun or disable.

    Failed jobs

    Job	Runner	Type	Cases / details
    test (default, 11, 12, linux.idc.xpu)	dut7902_pvc_card_1	timeout	Shard 11/12 · file shards passed 66/68 Timed out in inductor/test_torchinductor 1/2 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) Timed out in test_foreach 1/1 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) No matching timeout test-report artifact available
    test (default, 1, 12, linux.idc.xpu)	dut7364_pvc_card_7	timeout	Shard 1/12 · file shards passed 0/1 Timed out in lazy/test_ts_opinfo 1/1 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) No matching timeout test-report artifact available
    test (smoke_xpu, 1, 1, linux.client.xpu)	pytorch-b70-137_bmg_card_2	timeout	Shard 1/1 · file shards passed 0/3 Timed out in test_transformers 1/2 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) Timed out in test_transformers 2/2 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) TestXpuAutocast.test_autocast_torch_bf16 TestXpuAutocast.test_autocast_torch_fp16 TestAttnBiasXPU.test_causal_variants_causal_variant_2_shape1_xpu TestAttnBiasXPU.test_causal_variants_compile_causal_variant_1_shape0_xpu TestAttnBiasXPU.test_causal_variants_compile_causal_variant_2_shape1_xpu TestSDPAXpuOnlyXPU.test_flash_attention_vs_math_fused_kernel0_bfloat16_batch_size_1_n_head0_q_size_128_kv_size_128_head_dim_160_mask_type0_train_True_layout_bhsd_enable_gqa_True_xpu_bfloat16 TestSDPAXpuOnlyXPU.test_flash_attention_vs_math_fused_kernel0_bfloat16_batch_size_1_n_head0_q_size_128_kv_size_128_head_dim_160_mask_type0_train_True_layout_bshd_enable_gqa_False_xpu_bfloat16 ... and 864 more (total 871, >= threshold 7) No matching timeout test-report artifact available
    test (default, 9, 12, linux.idc.xpu)	dut7361_pvc_card_6	case failed	TestCommonXPU.test_python_ref_meta__refs_special_zeta_xpu_float64 TestCommonXPU.test_python_ref_torch_fallback__refs_special_zeta_xpu_float64

    _{File shards = test-file shards (not job-matrix shards). Unknown/candidate timeout cases are not confirmed culprits.}

    cc @chuanqi129 @ZhaoqiongZ @CuiYifeng
25. torchxpubot commented on Nov 12, 2026

    

    torchxpubot

    on Nov 12, 2026

    ContributorAuthor

    More actions

    Commit 5ac7f7b293c32d88d37dde7c48c12de1e344c53c — xpu.yml run

    Failed jobs

    Job	Runner	Type	Cases / details
    test (default, 9, 12, linux.idc.xpu)	dut7366_pvc_card_4	case failed	GPUTests.test_grid_sampler_expand_preserves_view_xpu

    Disable issues

    Job	Case	Issue
    test (default, 9, 12, linux.idc.xpu)	GPUTests.test_grid_sampler_expand_preserves_view_xpu	pytorch/pytorch#204580
26. torchxpubot commented on Nov 12, 2026

    

    torchxpubot

    on Nov 12, 2026

    ContributorAuthor

    More actions

    Run #14290 required manual intervention, but the newer run #14378 passed the auto-processing guardrails; resuming there.

    35 run(s) were skipped without auto-processing (the parked run was analyzed): #14290, #14291, #14293, #14295, #14296, #14300, #14301, #14302, #14304, #14305, #14307, #14310, #14312, #14313, #14314, #14317, #14318, #14322, #14327, #14330, #14333, #14334, #14338, #14343, #14346, #14348, #14350, #14352, #14356, #14358, #14361, #14367, #14369, #14371, #14374
27. torchxpubot commented on Nov 12, 2026

    

    torchxpubot

    on Nov 12, 2026

    ContributorAuthor

    More actions

    Commit 4976eb372698ea73c1bfc40a7b44c20052c8915a — xpu.yml run
    Timeout detected: manual investigation required; no automatic rerun or disable.

    Failed jobs

    Job	Runner	Type	Cases / details
    test (default, 10, 12, linux.idc.xpu)	dut7361_pvc_card_2	timeout	Shard 10/12 · file shards passed 0/67 Timed out in cpp_extensions/test_target_version_guard 1/1 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) Timed out in distributions/test_constraints 1/1 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) Timed out in dynamo/test_aot_compile 1/1 → Unknown (case not logged) (Timeout signal; in-flight candidate, not confirmed culprit) No matching timeout test-report artifact available
    test (default, 5, 12, linux.idc.xpu)	dut7901_pvc_card_1	case failed	CudaReproTests.test_conv_bias_no_extra_cast_for_fp32

    _{File shards = test-file shards (not job-matrix shards). Unknown/candidate timeout cases are not confirmed culprits.}

    cc @chuanqi129 @ZhaoqiongZ @CuiYifeng
28. torchxpubot commented on Nov 12, 2026

    

    torchxpubot

    on Nov 12, 2026

    ContributorAuthor

    More actions

    Commit 39ac148da6c5e4d3746a68990096ca34afba5b2c — xpu.yml run

    Failed jobs

    Job	Runner	Type	Cases / details
    test (default, 9, 12, linux.idc.xpu)	dut7902_pvc_card_1	case failed	TestBlackwellAutoWSConfigs.test_global_meta_ws_disables_flatten_global_meta_ws_False

    Disable issues

    Job	Case	Issue
    test (default, 9, 12, linux.idc.xpu)	TestBlackwellAutoWSConfigs.test_global_meta_ws_disables_flatten_global_meta_ws_False	pytorch/pytorch#204640
29. torchxpubot commented on Nov 12, 2026

    

    torchxpubot

    on Nov 12, 2026

    ContributorAuthor

    More actions

    Run #14381 required manual intervention, but the newer run #14403 passed the auto-processing guardrails; resuming there.

    8 run(s) were skipped without auto-processing (the parked run was analyzed): #14381, #14386, #14388, #14390, #14391, #14392, #14396, #14402