?
avatar Dave-Skye
Dave-Skye
23 Apr 2018

Hello

After upgrading a Joomla website to the current 3.8.7 then the robots.txt file has gained a extension of .dist. This prevents Google from finding the file and interferes with jobs such as uploading a site map.

If I manually remove the .dist then all works fine in google.

Is this a bug??

Cheers. - Dave.

avatar Dave-Skye Dave-Skye - open - 23 Apr 2018
avatar joomla-cms-bot joomla-cms-bot - change - 23 Apr 2018
Labels Added: ?
avatar joomla-cms-bot joomla-cms-bot - labeled - 23 Apr 2018
avatar brianteeman
brianteeman - comment - 23 Apr 2018

no your robots.txt has not gained an extension. A new file has been written to the root called robots.txt.dist

How did you do the upgrade?

avatar Dave-Skye
Dave-Skye - comment - 23 Apr 2018

Hello

I get this using the standard built in Joomla Update component.

I have just checked and it is then same of on all the Joomla websites i manage.

Cheers. - Dave.

avatar brianteeman
brianteeman - comment - 23 Apr 2018

there is no code that will rename your robots.txt to robots.txt.dist

avatar franz-wohlkoenig franz-wohlkoenig - change - 23 Apr 2018
Status New Discussion
avatar franz-wohlkoenig franz-wohlkoenig - change - 23 Apr 2018
Category com_joomlaupdate
avatar Bakual
Bakual - comment - 23 Apr 2018

I'm closing this issue as the presence of the robots.txt.dist is expected behavior.

avatar Bakual Bakual - change - 23 Apr 2018
Status Discussion Closed
Closed_Date 0000-00-00 00:00:00 2018-04-23 10:07:51
Closed_By Bakual
avatar Bakual Bakual - close - 23 Apr 2018
avatar Dave-Skye
Dave-Skye - comment - 23 Apr 2018

Hey

If it is an older website that is being upgraded then a new file is being added > robots.txt.dist

I have not worked out from which Joomla version this started. I manage over 50 Joomla websites and see this happening on all sites.

Cheers. - Dave.

avatar brianteeman
brianteeman - comment - 23 Apr 2018

yes that file is added - that is the expected behaviour - and has even been
in a post install message in the past
your existing robots.txt file is not removed from your web site

On 23 April 2018 at 11:10, Dave-Skye notifications@github.com wrote:

Hey

If it is an older website that is being upgraded then a new file is being
added > robots.txt.dist

I have not worked out from which Joomla version this started. I manage
over 50 Joomla websites and see this happening on all sites.

Cheers. - Dave.


You are receiving this because you commented.
Reply to this email directly, view it on GitHub
#20218 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABPH8fGMCvwDrDp0rcCO60Hqzop6130Qks5traiZgaJpZM4Tfjhu
.

--
Brian Teeman
Co-founder Joomla! and OpenSourceMatters Inc.
https://brian.teeman.net/ http://brian.teeman.net/

avatar Dave-Skye
Dave-Skye - comment - 23 Apr 2018

Hey

Ok - so if we wish to use the robot.txt file then it is a manual process to remove the .dist??

If this is the case that seems odd, making the Joomla less automated a setup.

Cheers.

avatar Bakual
Bakual - comment - 23 Apr 2018

What's your problem with the robots.txt.dist file? You don't have to remove that at all. It's there for convenience so you have a working example file you can copy or rename to robots.txt. You do that one time initially when you set up your site. Joomla will not create or alter the robots.txt file itself.

Feel free to use the forum (http://forum.joomla.org) for further questions about this feature.

avatar wojsmol
wojsmol - comment - 23 Apr 2018

@Bakual @Dave-Skye robots.txt.dist is renamed to robots.txt on Joomla! installation

// Rename the robots.txt.dist file if robots.txt doesn't exist
if ($return && !file_exists(JPATH_ROOT . '/robots.txt') && file_exists(JPATH_ROOT . '/robots.txt.dist'))
{
$return = JFile::move(JPATH_ROOT . '/robots.txt.dist', JPATH_ROOT . '/robots.txt');
}

but not on update.

avatar Bakual
Bakual - comment - 23 Apr 2018

@wojsmol Ah yes, in the step where you delete the installation folder.
I checked in my dev installation before writing it, but that one still has the installation folder since it's based on staging, not release, and thus the rbots.txt wasn't created ?

avatar Dave-Skye
Dave-Skye - comment - 23 Apr 2018

Hey @wojsmol

Yes this is what I would expect to happen, but I have some newer websites where the file is still called robots.txt.dist and the .dist has not been removed after the original installation.

Upgraded sites should keep the .dist to prevent overwriting any edits contained in the working file.

Seems like a bug somewhere to me.

Cheers.

avatar ReLater
ReLater - comment - 23 Apr 2018

Seems like a bug somewhere to me.

I cannot confirm this issue or a bug in Joomla core.
I've installed the staging version 3.8.8.-dev yesterday. And there is a robots.txt after installation and no robots.txt.dist. Means: I see the expected bahavior.

Upgraded sites should keep the .dist to prevent overwriting any edits contained in the working file.

That's the case with all of "my" upgraded/updated Joomla installations. 2 files. My edits untouched in robots.txt.

avatar SharkyKZ
SharkyKZ - comment - 24 Apr 2018

Yes this is what I would expect to happen, but I have some newer websites where the file is still called robots.txt.dist and the .dist has not been removed after the original installation.

As pointed out by @Bakual, this could have happened if you did not delete the installation folder (using the provided button after the installation).

On update, robots.txt.dist is not renamed to robots.txt, even if robots.txt is not found. This can be changed but, IMO, it shouldn't be. Some users may not want to user robots.txt for whatever reasons.

Add a Comment

Login with GitHub to post a comment