How do I fix indexed though blocked by robots txt in Blogger | Blogger error robot text files 2021
Автор: Information Hub Official
Загружено: 2021-11-18
Просмотров: 803
Описание:
Indexed, though blocked by robots.txt": what does it mean and how to fix?
Indexed, though blocked by robots.txt” indicates that Google indexed URLs even though they were blocked by your robots.txt file.
Google has marked these URLs as “Valid with warning” because they’re unsure whether you want to have these URLs indexed. In this article you'll learn how to fix this issue.
Normally, Google wouldn’t have indexed these URLs but apparently they found links to them and deemed them important enough to be indexed.
How to fix “Indexed, though blocked by robots.txt;
Export the list of URLs from Google Search Console and sort them alphabetically.
Go through the URLs and check if it includes URLs…
That you want to have indexed. If this is the case, update your robots.txt file to allow Google to access these URLs.
That you don’t want search engines to access. If this is the case, leave your robots.txt as-is but check if you’ve got any internal links that you should remove.
That search engines can access, but that you don’t want to have indexed. In this case, update your robots.txt to reflect this and apply
That shouldn’t be accessible to anyone, ever. Take for example, a staging environment. In this case, follow the steps explained.
In case it’s not clear to you what part of your robots.txt is causing these URLs to be blocked, select an URL and hit the TEST ROBOTS.TXT BLOCKING button in the pane that opens on the right hand side. This will open up a new window showing you what line in your robots.txt prevents Google from accessing the URL.
When you’re done making changes, hit the VALIDATE FIX button to request Google to re-evaluate your robots.txt against your URLs.
Повторяем попытку...
Доступные форматы для скачивания:
Скачать видео
-
Информация по загрузке: