Tests failed during evaluation of microsoftInternal__NAV-218253 Traceback (most recent call last): File "C:\vss-agent\2.334.0\_work\BC-Bench\BC-Bench\src\bcbench\evaluate\testgeneration.py", line 109, in evaluate run_test_suite(generated_tests, "Fail", container) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\vss-agent\2.334.0\_work\BC-Bench\BC-Bench\src\bcbench\operations\bc_operations.py", line 202, in run_test_suite raise TestExecutionError(expectation, e.stderr, e.stdout) from None bcbench.exceptions.TestExecutionError: Test result did not meet expectation (expected: Fail) Setting test codeunit range '137405' [16:03:37] Tests passed for Codeunit 137405

Tests failed during evaluation of microsoftInternal__NAV-208748 Traceback (most recent call last): File "C:\vss-agent\2.334.0\_work\BC-Bench\BC-Bench\src\bcbench\evaluate\testgeneration.py", line 119, in evaluate run_test_suite(generated_tests, "Pass", container) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\vss-agent\2.334.0\_work\BC-Bench\BC-Bench\src\bcbench\operations\bc_operations.py", line 202, in run_test_suite raise TestExecutionError(expectation, e.stderr, e.stdout) from None bcbench.exceptions.TestExecutionError: Test result did not meet expectation (expected: Pass) Setting test codeunit range '134377' Codeunit 134377 ERM Sales Blanket Order Testfunction SalesOrderFromBlanketOrderCarriesExtendedTextForAllItemLines Failure (2.9 seconds) Error: Assert.TableIsNotEmpty failed. Table <Sales Line> with filter <Document Type: Order, Document No.: 101010, Type: ' ', Description: E1> must contain records. Call Stack: Assert(CodeUnit 130000).RecRefIsNotEmpty line 3 - Tests-TestLibraries by Microsoft version 26.0.0.0 Assert(CodeUnit 130000).RecordIsNotEmpty line 5 - Tests-TestLibraries by Microsoft version 26.0.0.0 "ERM Sales Blanket Order"(CodeUnit 134377).VerifySalesOrderExtendedText line 8 - Tests-ERM by Microsoft version 26.0.0.0 "ERM Sales Blanket Order"(CodeUnit 134377).VerifySalesOrderExtendedTexts line 2 - Tests-ERM by Microsoft version 26.0.0.0 "ERM Sales Blanket Order"(CodeUnit 134377).SalesOrderFromBlanketOrderCarriesExtendedTextForAllItemLines line 31 - Tests-ERM by Microsoft version 26.0.0.0 "Test Runner - Mgt"(CodeUnit 130454).RunTests line 26 - Test Runner by Microsoft version 26.0.0.0 "Test Runner - Isol. Codeunit"(CodeUnit 130450).OnRun(Trigger) line 4 - Test Runner by Microsoft version 26.0.0.0 "Test Suite Mgt."(CodeUnit 130456).RunTests line 2 - Test Runner by Microsoft version 26.0.0.0 "Test Suite Mgt."(CodeUnit 130456).RunSelectedTests line 35 - Test Runner by Microsoft version 26.0.0.0 "Command Line Test Tool"(Page 130455)."RunSelectedTests - OnAction"(Trigger) line 7 - Test Runner by Microsoft version 26.0.0.0

Result for microsoftInternal__NAV-193853 missing metrics: llm_duration

Result for microsoftInternal__NAV-204450 missing metrics: llm_duration

Result for microsoftInternal__NAV-218253 missing metrics: llm_duration