We also had @bobbiechen.com join us for part of community day from connecting on the skyline, and we learned a bit about webbotauth datatracker.ietf.org/wg/webbotaut...
November 6, 2025 at 4:22 AM
We also had @bobbiechen.com join us for part of community day from connecting on the skyline, and we learned a bit about webbotauth datatracker.ietf.org/wg/webbotaut...
Will Allen VP Product @cloudflare.social talked about:
- AI Crawl Control (and Pay-Per-Crawl)
- webbotauth at IETF (and a little on AIPREFs)
- x402 payment FDN with Coinbase
… and answered a LOT of questions about how Cloudflare is NOT gonna be the next gatekeeper 🙃
#ProtocolsForPublishers
- AI Crawl Control (and Pay-Per-Crawl)
- webbotauth at IETF (and a little on AIPREFs)
- x402 payment FDN with Coinbase
… and answered a LOT of questions about how Cloudflare is NOT gonna be the next gatekeeper 🙃
#ProtocolsForPublishers
About to jump into this with @hackshackers.com and @cloudflare.social
#ProtocolsForPublishers
luma.com/t0tvnqsp?tk=...
#ProtocolsForPublishers
luma.com/t0tvnqsp?tk=...
AI Real Talk: How publishers can survive the AI age, a chat with Cloudflare VP of Product Will Allen · Zoom · Luma
Some tech companies have decided to push the boundaries of the law to get content train their AI models, scraping the web to suck up the data they need and…
luma.com
October 6, 2025 at 6:18 PM
Will Allen VP Product @cloudflare.social talked about:
- AI Crawl Control (and Pay-Per-Crawl)
- webbotauth at IETF (and a little on AIPREFs)
- x402 payment FDN with Coinbase
… and answered a LOT of questions about how Cloudflare is NOT gonna be the next gatekeeper 🙃
#ProtocolsForPublishers
- AI Crawl Control (and Pay-Per-Crawl)
- webbotauth at IETF (and a little on AIPREFs)
- x402 payment FDN with Coinbase
… and answered a LOT of questions about how Cloudflare is NOT gonna be the next gatekeeper 🙃
#ProtocolsForPublishers
El lado del mal - Cloudflare Radar: Bots Verificados & Signed Agents Identificados con Web Bot Auth www.elladodelmal.com/2025/09/clou... #AI #IA #AgenticAI #Bots #WebBotAuth #Cloudflare
Cloudflare Radar: Bots Verificados & Signed Agents Identificados con Web Bot Auth
Blog personal de Chema Alonso ( https://MyPublicInbox.com/ChemaAlonso ): Ciberseguridad, IA, Innovación, Tecnología, Cómics & Cosas Personasles.
www.elladodelmal.com
September 18, 2025 at 5:30 AM
El lado del mal - Cloudflare Radar: Bots Verificados & Signed Agents Identificados con Web Bot Auth www.elladodelmal.com/2025/09/clou... #AI #IA #AgenticAI #Bots #WebBotAuth #Cloudflare
I finally had a chance to catch up on webbotauth 124
datatracker.ietf.org/doc/agenda-1...
A crazy, half-baked thought - how much of the publishing web could be distributed through Authenticated Transfer instead, and in doing so shift costs from the publisher to the consumer (readers and crawlers)?
datatracker.ietf.org/doc/agenda-1...
A crazy, half-baked thought - how much of the publishing web could be distributed through Authenticated Transfer instead, and in doing so shift costs from the publisher to the consumer (readers and crawlers)?
Agenda IETF124: webbotauth
datatracker.ietf.org
November 7, 2025 at 11:08 PM
I finally had a chance to catch up on webbotauth 124
datatracker.ietf.org/doc/agenda-1...
A crazy, half-baked thought - how much of the publishing web could be distributed through Authenticated Transfer instead, and in doing so shift costs from the publisher to the consumer (readers and crawlers)?
datatracker.ietf.org/doc/agenda-1...
A crazy, half-baked thought - how much of the publishing web could be distributed through Authenticated Transfer instead, and in doing so shift costs from the publisher to the consumer (readers and crawlers)?
Cloudflare does webbotauth too (it's driven by some of their devs, though I don't know if they'd support it with just the signature). Maybe the other CDNs will come up with different setups, to keep things interesting. Also, it's by no means a standard or stable yet.
September 22, 2025 at 1:33 PM
Cloudflare does webbotauth too (it's driven by some of their devs, though I don't know if they'd support it with just the signature). Maybe the other CDNs will come up with different setups, to keep things interesting. Also, it's by no means a standard or stable yet.
Not all bots are evil. Some book flights, run SEO audits & help users quietly in the background. Web Bot Auth is the new standard that lets websites verify which AI agents are legit using cryptographic signatures.
New explainer 👇
techglimmer.io/what-is-web-...
#WebBotAuth #AI #infosec
New explainer 👇
techglimmer.io/what-is-web-...
#WebBotAuth #AI #infosec
What is Web Bot Auth? The New Standard for Verifying AI Agents Explained - techglimmer
Learn what is Web Bot Auth and how this new IETF standard uses cryptographic signatures to verify legitimate AI agents and block malicious bots from your website.
techglimmer.io
February 10, 2026 at 6:36 PM
Not all bots are evil. Some book flights, run SEO audits & help users quietly in the background. Web Bot Auth is the new standard that lets websites verify which AI agents are legit using cryptographic signatures.
New explainer 👇
techglimmer.io/what-is-web-...
#WebBotAuth #AI #infosec
New explainer 👇
techglimmer.io/what-is-web-...
#WebBotAuth #AI #infosec
FYI: Explaining Web Bot Auth #WebBotAuth #HTTPAuthentication #APIsecurity #DigitalIdentity #Potatosecurity
September 15, 2026 at 6:59 PM
FYI: Explaining Web Bot Auth #WebBotAuth #HTTPAuthentication #APIsecurity #DigitalIdentity #Potatosecurity
FYI: Explaining Web Bot Auth #WebBotAuth #HTTPAuthentication #APIsecurity #DigitalIdentity #Cybersecurity
Explaining Web Bot Auth
Web Bot Auth lets bots sign each HTTP request with a private key so sites verify identity instead of trusting headers. Mechanics, history, adoption, disputes.
ppc.land
September 15, 2026 at 6:58 PM
FYI: Explaining Web Bot Auth #WebBotAuth #HTTPAuthentication #APIsecurity #DigitalIdentity #Cybersecurity
FYI: Explaining Web Bot Auth #WebBotAuth #HTTPAuthentication #APIsecurity #DigitalIdentity #Cybersecurity
Explaining Web Bot Auth
Web Bot Auth lets bots sign each HTTP request with a private key so sites verify identity instead of trusting headers. Mechanics, history, adoption, disputes.
ppc.land
September 15, 2026 at 6:57 PM
FYI: Explaining Web Bot Auth #WebBotAuth #HTTPAuthentication #APIsecurity #DigitalIdentity #Cybersecurity
September 12, 2026 at 6:56 PM
Akamai supports WebBotAuth (draft) https://www.akamai.com/blog/security/redefine-trust-web-bot-authentication
November 10, 2025 at 2:34 PM
Akamai supports WebBotAuth (draft) https://www.akamai.com/blog/security/redefine-trust-web-bot-authentication
KI-Bot-Steckbriefe: Cloudflare überwacht, wie AI-Bots Crawling-Regeln einhalten, etwa IP-Verifizierung, WebBotAuth und robots.txt. Nur wer alles erfüllt, gilt als „gut“.
buff.ly
July 8, 2025 at 7:41 AM
KI-Bot-Steckbriefe: Cloudflare überwacht, wie AI-Bots Crawling-Regeln einhalten, etwa IP-Verifizierung, WebBotAuth und robots.txt. Nur wer alles erfüllt, gilt als „gut“.
Web Bot Auth (webbotauth)
https://datatracker.ietf.org/wg/webbotauth/about/
これについては初耳だったけど、preference signalなんかと比べてもいかにもまずそうだし、これに絞って別個に反対運動を展開するに値するのでは。というか下手したらWeb Environment Integrityの再来にならないかこれ
https://datatracker.ietf.org/wg/webbotauth/about/
これについては初耳だったけど、preference signalなんかと比べてもいかにもまずそうだし、これに絞って別個に反対運動を展開するに値するのでは。というか下手したらWeb Environment Integrityの再来にならないかこれ
Web Bot Auth (webbotauth)
datatracker.ietf.org
June 23, 2026 at 10:54 AM
Web Bot Auth (webbotauth)
https://datatracker.ietf.org/wg/webbotauth/about/
これについては初耳だったけど、preference signalなんかと比べてもいかにもまずそうだし、これに絞って別個に反対運動を展開するに値するのでは。というか下手したらWeb Environment Integrityの再来にならないかこれ
https://datatracker.ietf.org/wg/webbotauth/about/
これについては初耳だったけど、preference signalなんかと比べてもいかにもまずそうだし、これに絞って別個に反対運動を展開するに値するのでは。というか下手したらWeb Environment Integrityの再来にならないかこれ
This feels like the webbotauth problem, except trying to use user auth as a signal. The accessing user is paying a cost (identifying their client and giving parties a veto) to solve a service auth problem (which, fairly, is hard).
December 2, 2025 at 6:14 PM
This feels like the webbotauth problem, except trying to use user auth as a signal. The accessing user is paying a cost (identifying their client and giving parties a veto) to solve a service auth problem (which, fairly, is hard).
Chairs have decided to revisit and publish requirements and use cases. A good decision!
https://datatracker.ietf.org/doc/charter-ietf-webbotauth/
https://datatracker.ietf.org/doc/charter-ietf-webbotauth/
Web Bot Auth
datatracker.ietf.org
November 4, 2025 at 9:10 PM
Chairs have decided to revisit and publish requirements and use cases. A good decision!
https://datatracker.ietf.org/doc/charter-ietf-webbotauth/
https://datatracker.ietf.org/doc/charter-ietf-webbotauth/
WebBotAuth is a proposed standard for signing HTTP requests so the server knows who is requesting the data. All fine so far; it's what we use for ActivityPub for domain blocking, for example.
November 4, 2025 at 7:45 PM
WebBotAuth is a proposed standard for signing HTTP requests so the server knows who is requesting the data. All fine so far; it's what we use for ActivityPub for domain blocking, for example.
November 4, 2025 at 7:41 PM
There's Web Bot Auth datatracker.ietf.org/wg/webbotaut... which is meant to facilitate the latter, and Cloudflare also uses it for their "pay-per-crawl" setup (though I wish there were other companies implementing that too)
Web Bot Auth (webbotauth)
datatracker.ietf.org
June 21, 2026 at 2:42 PM
There's Web Bot Auth datatracker.ietf.org/wg/webbotaut... which is meant to facilitate the latter, and Cloudflare also uses it for their "pay-per-crawl" setup (though I wish there were other companies implementing that too)