Google’s Gary Illyes confirmed that he has started working on the Robots.txt tester tool, currently placed in the Google Search console’s old version. Gary came up with information as there were some complaints about the Robots.txt tester tool having a bug and how Google reads a site’s robots.txt file.
He also said that they are currently trying to integrate the tester with the parser’s production version. He also acknowledged the tool’s possible problem and assured that people would know it for sure once the tool is updated with the parser’s production version.
Gary’s tweet about the tool
we’ll look, but it’s likely a tool error. we’re currently in the process(*) of integrating the tester with the production version of the parser which should fix this, if indeed it is a tool error.
* – it’s my procrastination project, so no holding breaths
— Gary 鯨理／경리 Illyes (@methode) January 6, 2021
Robots.txt tools are updated regularly by Google to weed out imperfections. Let’s hope this time around, the issue surrounding the tool’s efficiency is resolved with the current update.
1 thought on “Google Start Working on the Improvement of Robots.txt Tester Tool”
Excellent update! Robots.txt Tester helps Webmasters to analyze their robots.txt file and highlight the issues that would prevent them from getting optimally crawled by Bing and other robots.