Google is evaluating alternatives to robots.txt
AI as the sticking point: Google is examining alternatives to robots.txt
In times of AI, Google is considering alternatives to the robots.txt file. To this end, the company invites people from the AI community to a discussion.