Steps to reproduce the issue

1. Use Laragon or other WAMP stack with PHP 8.3 or higher active
2. Download Joomla en unzip in a folder in the server root so it can be accessed via your https://localhost or simular.
3. Open the folder in the console/command line tool and run the php command below

php installation/joomla.php install --site-name="Joomla Website" --admin-user="User" --admin-username="admin" --admin-password="qwertyuiop1234567890" --admin-email="me@example.com" --public-folder="" --db-type="mysqli" --db-host="localhost" --db-user="root" --db-pass="" --db-name="joomladb" --db-prefix="joomla_" --db-encryption="0"

Expected result

Joomla in installed without warnings

Actual result

Install Joomla

Checking system requirements...OK
Collecting configuration...OK
Validating DB connection...OK
Creating and populating the database...OK
Writing configuration.php and additional setup ...OK
Deleting /installation folder...
In Folder.php line 268:

Joomla\Filesystem\Folder::delete: Could not delete folder. Path: [ROOT]\installation

System information (as much as possible)

Laragon 6 with PHP 8.3

Additional comments

There where similar problems when installing using the default way in PR: #37938. It looks like the problem is the same with the CLI installer.