Skip to content

[Bug]: Benchmarks workflow references non-existent package directories #1825

@danyalahmed1995

Description

@danyalahmed1995

Package

agent-os-kernel

Description

The Benchmarks workflow appears to reference package directories and benchmark script paths that do not exist from the configured working directories.

In .github/workflows/benchmarks.yml, the workflow uses root-level working directories such as:

working-directory: agent-os

and:

working-directory: agent-sre

However, those directories do not appear to exist at the repository root. The actual package directories appear to be:

agent-governance-python/agent-os
agent-governance-python/agent-sre

The benchmark script paths also appear to point at:

agent-governance-python/benchmarks/...

but the benchmark scripts appear to live under the package-specific benchmark directories, for example:

agent-governance-python/agent-os/benchmarks/bench_policy.py
agent-governance-python/agent-sre/benchmarks/bench_chaos.py

Because of this, the workflow can fail before running the benchmark scripts.

### Steps to Reproduce

```md
From the repository root, run:

```powershell
Test-Path agent-os
Test-Path agent-sre
Test-Path agent-governance-python\agent-os
Test-Path agent-governance-python\agent-sre
Test-Path agent-governance-python\benchmarks\bench_policy.py
Test-Path agent-governance-python\agent-os\benchmarks\bench_policy.py

Then try to enter the configured workflow working directory:

Push-Location agent-os

### Environment

```md
- Repository: `microsoft/agent-governance-toolkit`
- Branch: `main`
- OS used for local verification: Windows
- Shell used for local verification: PowerShell
- Affected file: `.github/workflows/benchmarks.yml`
- Affected workflow: Benchmarks

### Logs / Error Output

```shell
Test-Path agent-os
False

Test-Path agent-sre
False

Test-Path agent-governance-python\agent-os
True

Test-Path agent-governance-python\agent-sre
True

Test-Path agent-governance-python\benchmarks\bench_policy.py
False

Test-Path agent-governance-python\agent-os\benchmarks\bench_policy.py
True

Push-Location agent-os
Push-Location : Cannot find path '...\agent-os' because it does not exist.

Code of Conduct

  • I agree to follow the Microsoft Open Source Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingtriageNeeds triage

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions