#Applebot
FBI: Threat actors are using autonomous AI agents.
Me: Blocked gptbot and applebot.

Mission accomplished. Peace and quiet restored.
November 17, 2026 at 10:44 PM
About Applebot - Apple Support
Learn about Applebot, the web crawler for Apple.
support.apple.com
November 12, 2026 at 2:15 PM
The bigger surprise is the "Block" setting. In Cloudflare's own words, it "will stop Applebot, Bingbot, and Googlebot from reaching your site - search included."
November 16, 2026 at 10:00 AM
The biggest offenders by IP Range in order:
1) Amazon\AWS
2) ClaudeBot
3) OpenAI
4) Apple/Applebot
November 13, 2026 at 4:22 AM
Doing some bot culling after new AI bots have gotten to be too aggressive about crawling my site.

NGINX snippets FTW.

#nginx #aibots #bothunt
November 15, 2026 at 4:36 PM
On Cloudflare? Check one setting today.

Since 15 September 2026, blocking AI training there can also stop crawlers that do search and training together. Cloudflare names Googlebot, Bingbot and Applebot.

https://getayka.com

#Cloudflare #SEO #WebDev
November 14, 2026 at 6:24 PM
Answer bots bring you into AI answers; training bots feed future models. You can say no to training and still be in the answers. The cheat sheet:

https://getayka.com/

#SEO #GEO #AISearch
November 11, 2026 at 3:34 PM
Cloudflare's two posts name 3 crawlers as multi-purpose: Googlebot, Applebot, BingBot.

They name 0 operators as meeting its conditions to stay unblocked, so the published way out has no one shown taking it.

https://answerengineered.com/articles/cloudflare-four-conditions-nobody-named/
November 11, 2026 at 8:00 PM
```
Cloudflare may have blocked Google on your site since Sept 15: "Block" now also applies to Googlebot, Bingbot and Applebot. Keep search with "Disallow AI Training". Edge blocks never show in robots.txt. Guide: https://atalaya-ai.com/guides/cloudflare-ai-crawlers-blocked/
```
November 5, 2026 at 5:05 PM
Cloudflare pudo bloquear a Google en tu sitio desde el 15 sep: "Block" ahora alcanza a Googlebot, Bingbot y Applebot. Conserva la búsqueda con "Disallow AI Training". Los bloqueos de borde no salen en robots.txt. Guía: https://atalaya-ai.com/es/guias/cloudflare-rastreadores-ia-bloqueados/
November 5, 2026 at 1:05 AM
En Cloudflare, "Block" para rastreadores de IA ahora también frena a Googlebot, Bingbot y Applebot (blog de Cloudflare, 15 sept). Eso es búsqueda, no solo entrenamiento.

¿Entrenamiento no y búsqueda sí? Usa "Disallow AI Training".

Guía abajo. (Escrito con IA)
Cloudflare dice permitir, pero los rastreadores de IA siguen bloqueados
Cinco ajustes de Cloudflare para revisar, en orden.
atalaya-ai.com
October 30, 2026 at 9:05 PM
On Cloudflare, "Block" for AI crawlers now also stops Googlebot, Bingbot and Applebot (Cloudflare's blog, Sept 15). That's search, not just training.

Want training off and search on? Pick "Disallow AI Training".

Five settings to check in our guide below. (AI-written)
Cloudflare says allow, but AI crawlers are still blocked
Five Cloudflare settings to check, in order.
atalaya-ai.com
October 29, 2026 at 9:05 PM
my site's agent-readiness score went from 20 to 87

now chatform gets ~39k AI citations a month

applebot alone: 10.37k requests. google 6.76k. anthropic 2.84k. openai 2.11k

comment "citations" and i'll send you the exact guide 👇
October 30, 2026 at 7:53 AM
Google-Extended y Applebot-Extended nunca visitan tu sitio. Solo le dicen a Google y Apple si lo que ya descargaron puede entrenar IA. Bloquearlos no te saca de la búsqueda.

robots.txt para copiar: https://atalaya-ai.com/es/guias/bloquear-entrenamiento-ia/

(Video hecho con IA)
October 29, 2026 at 4:33 AM
Mediet med AI-genereret indhold vil ikke have, at AI-bots henter indhold fra dem.
October 27, 2026 at 5:14 PM
These aren't crawlers, they're AI assistants requesting information from our site, so we're adding an x402 payment system that let's agents sign up for $10, for 1,000 requests.

We don't expect any subs, and we might die from shock if they do, but we're trying it anyway 😂
October 27, 2026 at 2:18 AM
Google-Extended and Applebot-Extended never visit your site. They only tell Google and Apple whether pages they already fetched may train AI. Blocking them keeps you in search.

Copy-paste robots.txt: https://atalaya-ai.com/guides/block-ai-training/

(AI-made video)
October 26, 2026 at 3:05 PM
Customer: "Hey ChatGPT, who's a good plumber near me?"
ChatGPT: *recommends your competitor*
You: "I've fixed pipes for 22 years"
Your robots.txt: Disallow: /

Not saying that's the whole reason. It's not helping, though.

Free check: localcited.valleyfill.com/tools/ai-cra...
AI Crawler Checker: Is GPTBot or ClaudeBot Blocked? Free | LocalCited
Free check of your robots.txt against OpenAI (GPTBot, OAI-SearchBot, ChatGPT-User), Anthropic (ClaudeBot), Google-Extended, Applebot, Common Crawl and other AI crawlers, with plain-English fixes.
localcited.valleyfill.com
October 26, 2026 at 2:28 AM
Got my monthly @cloudflare.social and D1 reads for con.vey.dev were absurdly high like nearly 100B row reads, turns out in just the last 7 days the Applebot crawler has made 560,000(!!!!!) requests mostly to the tags endpoint and bizarrely almost every search contained "jak jones"
con.vey.dev | the standard.site directory
Every standard.site publication in the ATmosphere, indexed and searchable on con.vey.dev.
con.vey.dev
October 25, 2026 at 12:46 AM
#apple gibt so gar keinen f auf Ressourcen, eh?
(Das sind Abrufe in 24 Stunden…)
October 19, 2026 at 8:25 PM
A new switch in the SEO settings asks AI crawlers like GPTBot and ClaudeBot not to train on your site.

EmDash adds the rules to robots.txt, and search engines are unaffected.
October 16, 2026 at 3:35 PM
It sure looks like #Applebot no longer is a hobby. In the past my campus server would see one or two every few days. This spring there was a period with a few 100k requests. In the last two weeks there have been nearly 1.5M requests.
October 14, 2026 at 9:15 PM
Annoying not to see Applebot on Cloudflare's AI Insights dash. I thought Applebot activity has spiked of late... radar.cloudflare.com/ai-insights?...
October 13, 2026 at 1:00 PM
Two more from the operators' own docs. Google-Extended and Applebot-Extended aren't crawlers, nothing fetches under those names. And OpenAI says robots.txt rules "may not apply" to ChatGPT-User, because a person asked for the page.
October 14, 2026 at 9:59 AM
A small thing that confuses a lot of site owners: Google-Extended never visits your site.

It's a robots.txt token. Block it and Google stops using your content for Gemini training, while Googlebot still crawls for Search. Same pattern for Applebot-Extended.

https://webmasterid.com/ai-crawlers
October 12, 2026 at 12:05 AM