Skip to content

Enable AL-LSP for evaluation #2208

Enable AL-LSP for evaluation

Enable AL-LSP for evaluation #2208

Triggered via pull request May 28, 2026 12:01
Status Success
Total duration 5m 8s
Artifacts 5

CI.yml

on: pull_request
select-category
16s
select-category
lint-and-test
35s
lint-and-test
get-entries  /  get-entries
13s
get-entries / get-entries
Matrix: mock-evaluation
summarize-results  /  Results
54s
summarize-results / Results
Fit to window
Zoom out
Zoom in

Annotations

5 warnings
lint-and-test
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
bcbench.results.base
Result for microsoft__BCApps-4822 missing metrics: execution_time, llm_duration, turn_count, prompt_tokens, completion_tokens, tool_usage
bcbench.results.base
Result for microsoftInternal__NAV-177750 missing metrics: execution_time, llm_duration, turn_count
bcbench.results.base
Creating result for microsoftInternal__NAV-177493 with no agent metrics - performance data will be unavailable
bcbench.results.base
Result for microsoftInternal__NAV-224009 missing metrics: turn_count, completion_tokens

Artifacts

Produced during runtime
Name Size Digest
evaluation-summary Expired
564 Bytes
sha256:81cea027bb9965217a119b162aa3aa96b7aaac11d52abff8524167f2d54e3834
microsoftInternal__NAV-177493 Expired
421 Bytes
sha256:663754dd80b96f3349c0aaca950df17e7a7923acf575b6a96b1faa1aff2736b3
microsoftInternal__NAV-177750 Expired
555 Bytes
sha256:bc1cfbc9fe0b551ca2fba98dc063b952aab0c3ae742d4235453a6544dad02bd8
microsoftInternal__NAV-224009 Expired
543 Bytes
sha256:f759f66597c8a5db4ff11992fbf4d2ae9df6b265ad430080ef8341b50dcc40a5
microsoft__BCApps-4822 Expired
484 Bytes
sha256:69f368929bd60c9ca4c41a29dc9dc7efb23ff8e8de223dcd2ae79be71460bdd9