Merge pull request #5255 from magento/ken-gh5237-robot-errors

Added Note for 404 error regarding /robots.txt files

Author: hickskenh

guides/v2.2/cloud/trouble/robots-sitemap.md

@@ -7,43 +7,47 @@ functional_areas:
 ---
 An attempt to generate and write the `sitemap.xml` file to the root directory results in the following error:
 
-```
+```terminal
 Please make sure that "/" is writable by the web-server.
 ```
 
 With {{site.data.var.ece}}, you can only write to specific directories, such as `var`, `pub/media`, `pub/static`, or `app/etc`. When you generate the `sitemap.xml` file using the Admin panel, you must specify the `/media/` path.
 
-You do not have to generate a `robots.txt` because it generates on demand and stores the contents in the database. It does not create a file, but you can view the content in your browser with the url: `<domain.your.project>/robots.txt`
+You do not have to generate a `robots.txt` because it generates on demand and stores the contents in the database. It does not create a file, but you can view the content in your browser with the `<domain.your.project>/robots.txt` file.
 
 This requires ECE-Tools version 2002.0.12 and later with an updated `.magento.app.yaml` file. See an example of these rules in the [magento-cloud repository](https://github.com/magento/magento-cloud/blob/master/.magento.app.yaml#L43-L49).
 
-#### To generate a `sitemap.xml` file in version 2.2 and later:
+#### To generate a `sitemap.xml` file in version 2.2 and later
+
+1. Access the Magento Admin panel.
+1. On the _Marketing_ menu, click **Site Map** in the _SEO & Search_ section.
+1. In the _Site Map_ view, click **Add Sitemap**.
+1. In the _New Site Map_ view, enter the following values:
 
-1.  Access the Magento Admin panel.
-1.  On the _Marketing_ menu, click **Site Map** in the _SEO & Search_ section.
-1.  In the _Site Map_ view, click **Add Sitemap**.
-1.  In the _New Site Map_ view, enter the following values:
+   -  **Filename**:`sitemap.xml`
+   -  **Path**:`/media/`
 
-    -  **Filename**:`sitemap.xml`
-    -  **Path**:`/media/`
+1. Click **Save & Generate**. The new site map becomes available in the _Site Map_ grid.
+1. Click the path in the _Link for Google_ column.
 
-1.  Click **Save & Generate**. The new site map becomes available in the _Site Map_ grid.
-1.  Click the path in the `Link for Google` column.
+#### To add content to `robots.txt` file
 
-#### To add content to `robots.txt` file:
+1. Access the Magento Admin panel.
+1. On the _Content_ menu, click **Configuration** in the _Design_ section.
+1. In the _Design Configuration_ view, click **Edit** for the website in the _Action_ column.
+1. In the _Main Website_ view, click **Search Engine Robots**.
+1. Make changes to the **Edit custom instruction of robots.txt** field.
+1. Click **Save Configuration**.
+1. Verify the `<domain.your.project>/robots.txt` file in your browser.
 
-1.  Access the Magento Admin panel.
-1.  On the _Content_ menu, click **Configuration** in the _Design_ section.
-1.  In the _Design Configuration_ view, click **Edit** for the website in the _Action_ column.
-1.  In the _Main Website_ view, click **Search Engine Robots**.
-1.  Make changes to the **Edit custom instruction of robots.txt** field.
-1.  Click **Save Configuration**.
-1.  Verify the file in your browser with the url: `<domain.your.project>/robots.txt`
+{:.bs-callout .bs-callout-info}
+If the `<domain.your.project>/robots.txt` file generates a `404 error`, [submit a Support ticket](https://support.magento.com/hc/en-us/articles/360019088251-Submit-a-support-ticket) to remove the redirect from `/robots.txt` to `/media/robots.txt`.
 
 ## Rewrite using Fastly VCL snippet
+
  If you have different domains and you need separate site maps, you can create a VCL to route to the proper sitemap. Generate the `sitemap.xml` file in the Magento Admin panel as described above, then create a custom Fastly VCL snippet to manage the redirect. See [Custom Fastly VCL snippets]({{ page.baseurl }}/cloud/cdn/cloud-vcl-custom-snippets.html).
 
-#### To use a Fastly VCL snippet for redirect:
+### To use a Fastly VCL snippet for redirect
 
 Create a custom VCL snippet to rewrite the path for `sitemap.xml` to `/media/sitemap.xml` using the `type` and `content` key-value pairs.