sel logo
Search Engine Land » SEO » Google Search Console adds robots.txt report
Google has released a new robots.txt report within Google Search Console. Google also made relevant information around robots.txt available from within the Page indexing report in Search Console. Finally, Google has decided to sunset the robots.txt tester.
The new robots.txt report. Google’s new robots.txt report shows gives you some information Google has on your robots.txt file including:
Google also added to this report the ability request a recrawl of a robots.txt file for emergency situations, Google said.
What it looks like. You can access this report within Google Search Console under settings, here is what it looks like:
More. Google also made relevant information around robots.txt available from within the Page indexing report in Search Console.
With this new robots.txt report, Google has decided to sunset the robots.txt tester.
More help. Google has a more detailed help document on this robots.txt report over here.
Why we care. If you are having indexing and crawling issues, this report may give you more insight into if the issue is related to your robots.txt file.
You should probably review this report for the sites you manage within Google Search Console, just to ensure there are no issues with Google being able to access your site due to robots.txt directives.
Related stories
New on Search Engine Land
About the author
Related topics
Get the daily newsletter search marketers rely on.
See terms.
Learn actionable search marketing tactics that can help you drive more traffic, leads, and revenue.
March 15-16, 2023: SMX Munich
Online Aug. 16-17: SMX Master Classes
Start training now: SMX Next
Start training now: SMX Advanced
Discover time-saving technologies and actionable tactics that can help you overcome crucial marketing challenges.
April 15-17, 2020: San Jose
Hype Check: What Marketers Really Want to Know About Generative AI
Trends in Paid Search: Navigating the Digital Landscape in 2024
2024: The End of the Third-Party Cookie. So, What Now?
Enterprise Marketing Attribution and Performance Management Platforms: A Marketer’s Guide
Enterprise Account-Based Marketing Platforms: A Marketer’s Guide
Enterprise Marketing Work Management Platforms: A Marketer’s Guide
The Definitive Guide for Writing and Designing Emails That Convert
Meet your new AI-powered marketing assistant!
Get the must-read newsletter for search marketers.
Topics
Our events
About
Follow us
© 2023 Third Door Media, Inc. All rights reserved.
Third Door Media, Inc. is a publisher and marketing solutions provider incorporated in Delaware, USA, with an address 88 Schoolhouse Road, PO Box 3103, Edgartown, MA 02539. Third Door Media operates business-to-business media properties and produces events. It is the publisher of Search Engine Land the leading Search Engine Optimization digital publication.

source