Crypto Ticker:
sysadmin from 4sysops.com

AI giants back one robots.txt opt-out for training crawlers

IT News
9 hours ago
9 Views
0 Comments
AI giants back one robots.txt opt-out for training crawlers

OpenAI, Google, Microsoft, and Anthropic will support a shared robots.txt signal that lets publishers state whether their content may be used to train AI models. The proposed policy token aims to replace separate opt-outs for each company’s crawler, but support will roll out gradually. Source

Read the full article at the source.

Join the discussion — comment, vote, and submit links.

Register
Was this helpful?
Share:

Comments (0)

Please login or register to join the discussion

No comments yet. Be the first to comment!