Google is evaluating alternatives to robots.txt

AI as the sticking point: Google is examining alternatives to robots.txt

In times of AI, Google is considering alternatives to the robots.txt file. To this end, the company invites people from the AI ​​community to a discussion.