AI · Policy · 2026-11-01 18:04
The draft proposes embedding purpose-specific policy tokens in the User-Agent line of robots.txt, letting sites express usage preferences such as prohibiting AI training using existing syntax.
Auto-generated summary for reference only. RSS