At the time of launching the site you need to check the presence and contents of the robots.txt file
This file contains rules for search engines about what can be indexed (crawled) on your site, and what is not.
So for SkeekS CMS (Yii2) the correct default file looks like this:
User-agent: * Disallow: /~* Host: skeeks.com Sitemap: http://skeeks.com/sitemap.xml
Instead of skeeks.com - the name of your site.
1) The easiest most frequent option
Suitable for most sites:
Go to the administration system at Content -> File Manager -> Root
Paste content and save
Based on the SkeekS CMS platform, it is possible to build a portal (many sites in one), respectively, in this case, each of the domains needs its own robots.txt file and we will write later on how to do this in the CMS.
- Dec 30, 2019
- Aug 14, 2019