Enable AL-LSP for evaluation #2208
CI.yml
on: pull_request
select-category
16s
lint-and-test
35s
Matrix: mock-evaluation
summarize-results
/
Results
54s
Annotations
5 warnings
|
lint-and-test
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
bcbench.results.base
Result for microsoft__BCApps-4822 missing metrics: execution_time, llm_duration, turn_count, prompt_tokens, completion_tokens, tool_usage
|
|
bcbench.results.base
Result for microsoftInternal__NAV-177750 missing metrics: execution_time, llm_duration, turn_count
|
|
bcbench.results.base
Creating result for microsoftInternal__NAV-177493 with no agent metrics - performance data will be unavailable
|
|
bcbench.results.base
Result for microsoftInternal__NAV-224009 missing metrics: turn_count, completion_tokens
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
evaluation-summary
Expired
|
564 Bytes |
sha256:81cea027bb9965217a119b162aa3aa96b7aaac11d52abff8524167f2d54e3834
|
|
|
microsoftInternal__NAV-177493
Expired
|
421 Bytes |
sha256:663754dd80b96f3349c0aaca950df17e7a7923acf575b6a96b1faa1aff2736b3
|
|
|
microsoftInternal__NAV-177750
Expired
|
555 Bytes |
sha256:bc1cfbc9fe0b551ca2fba98dc063b952aab0c3ae742d4235453a6544dad02bd8
|
|
|
microsoftInternal__NAV-224009
Expired
|
543 Bytes |
sha256:f759f66597c8a5db4ff11992fbf4d2ae9df6b265ad430080ef8341b50dcc40a5
|
|
|
microsoft__BCApps-4822
Expired
|
484 Bytes |
sha256:69f368929bd60c9ca4c41a29dc9dc7efb23ff8e8de223dcd2ae79be71460bdd9
|
|