Agents problem running seed.spec.ts

[ignatandrei]

VS Code v1.105 has appeared as stable ( you may want to improve the page https://playwright.dev/docs/test-agents )

So I tried to try https://playwright.dev/docs/test-agents with ASPIRE ;-)

I have followed the tutorial, but the planner gives an error when run the test seed ( it says that "Error: Playwright Test did not expect test.describe() to be called here." - detailed error as image below )

This is the seed.spec.ts file - generated by playwright

import { test, expect } from '@playwright/test';

test.describe('Test group', () => {
  test('seed', async ({ page }) => {
    // generate code here.
  });
});

( I have tried to delete describe, and he didn't like test....)

Please advise what is wrong in the seed file .

---

[pavelfeldman]

Nothing is wrong with the seed file, but your agent started its mcp servers in a wrong directory. This usually means that you are not using v1.105. Also playwright-test MCP is a separate project. How did you configure your workspace?

[ignatandrei]

This is my VS Code version

( maybe I should wait another version of VSCode and I was too entuziast ? ;-) )

Also , this is my workspace folder :
GenerateTest.zip

[pavelfeldman]

There are no agent definitions in the zip (probably .github folder was not included?). We are all using it, you are not too enthusiastic, something is wrong with the set up and I'm happy to help.

[ignatandrei]

Sorry, but the .github folder IS in the zip . I have downloaded the zip on my PC and this is the result :

Could you verify again, please ? ( and check if you have unblock the file before unzip )
( And thanks for the help!)

[pavelfeldman]

I modified seed to be:

import { test, expect } from '@playwright/test';

test.beforeEach(async ({ page }) => {
  await page.goto('https://demo.playwright.dev/todomvc/');
});

test.describe('Test group', () => {
  test('seed', async ({ page }) => {
    // generate code here.
  });
});

And then I asked #planner to generate a plan with the seed file in context:

[ignatandrei]

I have replaced content with your seed ( you have added just a beforEach ) Unfortunately, on my system, is the error with beforeEach now

Did you reproduce my error first ? ;-)

[pavelfeldman]

Maybe you did not run npm i in your repo? Always check your seed test via manually running it.

[ignatandrei]

I have done the npm i - this is the content folder of node_modules

.bin
.package-lock.json
@playwright
@types
playwright
playwright-core
undici-types 

I do not know what to do next. But just a question: did you reproduce , with original seed.spec.ts file, my problem ?

[pavelfeldman]

No, original seed.spec.ts did not cause any problems. If you run npx playwright test, does it run your seed test?

[ignatandrei]

Yes, it runs fine. I can set a devtunnel in VsCode to allow you to take a look of what is happening. Or other software that you prefer remoting into my laptop....

[pavelfeldman]

The error you are experiencing can only happen if playwright-test MCP (npx playwright run-test-mcp-server) starts it in a wrong folder, not the ${workspaceFolder}. Older VS Codes were doing that, but you are on a new 1.105 one. Let me try your project with a clear Windows VM.

[ignatandrei]

If you want , please see the code at ;

The repo is
https://github.com/ignatandrei/aspireExtensions

And the folder is
https://github.com/ignatandrei/aspireExtensions/tree/main/src/GenerateTest

And I open the folder GenerateTest in VSCode

[pavelfeldman]

Well that's embarrassing, I can repro the issue on Windows!

[ignatandrei]

That's actually good - for me 😉 . Now all I have to do is wait ;-) ( I doubt I can debug the issue to figure why , even if the code is here on github )