CLI installer cannot remove installation folder on Windows

[RickR2H]

Steps to reproduce the issue

1. Use Laragon or other WAMP stack with PHP 8.3 or higher active
2. Download Joomla en unzip in a folder in the server root so it can be accessed via your https://localhost or simular.
3. Open the folder in the console/command line tool and run the php command below

php installation/joomla.php install --site-name="Joomla Website" --admin-user="User" --admin-username="admin" --admin-password="qwertyuiop1234567890" --admin-email="me@example.com" --public-folder="" --db-type="mysqli" --db-host="localhost" --db-user="root" --db-pass="" --db-name="joomladb" --db-prefix="joomla_" --db-encryption="0"

Expected result

Joomla in installed without warnings

Actual result

Install Joomla

Checking system requirements...OK
Collecting configuration...OK
Validating DB connection...OK
Creating and populating the database...OK
Writing configuration.php and additional setup ...OK
Deleting /installation folder...
In Folder.php line 268:

Joomla\Filesystem\Folder::delete: Could not delete folder. Path: [ROOT]\installation

System information (as much as possible)

Laragon 6 with PHP 8.3

Additional comments

There where similar problems when installing using the default way in PR: #37938. It looks like the problem is the same with the CLI installer.

[brianteeman]

Same problem and same reason - no need for an additional issue just add that the problem is present with CLI as well in the original issue