Standards to indicate permissions for internet scraping for AI training

There is an IETF process underway to standardize a machine readable way to indicate permissions associated with how online content can be used for AI training. The aim is to find an ai.txt specification analogous to the robot.txt specification put on many websites. For more information see: https://datatracker.ietf.org/group/aicontrolws/materials/ Feedback is sought. Benson

As a software engineer, I support ai.txt as a simple, respectful way to express AI usage preferences. For wide adoption, it must be easy to implement, enforceable, and fine-grained to allow creators to distinguish between indexing, caching, and training use cases. I also recommend establishing a shared standard registry for AI user-agents and encouraging bots to self-identify with verifiable headers. Aaron Muuo. On Thu, May 15, 2025 at 8:57 PM Benson Muite via KICTANet < [email protected]> wrote:
There is an IETF process underway to standardize a machine readable way to indicate permissions associated with how online content can be used for AI training. The aim is to find an ai.txt specification analogous to the robot.txt specification put on many websites. For more information see: https://datatracker.ietf.org/group/aicontrolws/materials/
Feedback is sought.
Benson _______________________________________________ KICTANet mailing list -- [email protected] To unsubscribe send an email to [email protected] Unsubscribe or change your options at: https://mm3-lists.kictanet.or.ke/mm/lists/kictanet.lists.kictanet.or.ke/ Archived at: https://lists.kictanet.or.ke/archives/list/[email protected]/mes...
Mailing List Posts Online: https://posts.kictanet.or.ke/
Twitter: https://twitter.com/KICTANet/ Facebook: https://www.facebook.com/KICTANet/ Instagram: https://www.instagram.com/KICTANet/ LinkedIn: https://www.linkedin.com/company/kictanet/ YouTube: https://www.youtube.com/channel/UCbcLVjnPtTGBEeYLGUb2Yow/ WhatsApp Channel: https://whatsapp.com/channel/0029VaQsX4w6mYPIctLsGh1K
KICTANet is a multi-stakeholder Think Tank for people and institutions interested and involved in ICT policy and regulation. KICTANet is a catalyst for reform in the Information and Communication Technology sector. Its work is guided by four pillars of Policy Advocacy, Capacity Building, Research, and Stakeholder Engagement.
KICTANetiquette : Adhere to the same standards of acceptable behaviors online that you follow in real life: respect people's times and bandwidth, share knowledge, don't flame or abuse or personalize, respect privacy, do not spam, do not market your wares or qualifications.
PRIVACY POLICY: See https://mm3-lists.kictanet.or.ke/mm/lists/kictanet.lists.kictanet.or.ke/
KICTANet - The Power of Communities, is Kenya's premier ICT policy engagement platform.
participants (2)
-
Aaron Muuo
-
Benson Muite