What is measured
The audit applies robots.txt rules to the starting URL and detects a site-wide Disallow: / directive.
Technical access and indexing
Crawler access to the website
This check determines whether a general search crawler may access the website root.
Pass criterion
After launch, public pages can be crawled and restrictions are limited to utility areas.
What to fix
Remove the global production block and retain targeted rules for admin, API and other non-search routes.
Automation limit
robots.txt controls crawling but is not a reliable way to remove an already known URL from an index; accessible noindex is used for that purpose.
Reference