"noindex, follow" is the "thoughts and prayers" of technical SEO.
November 20, 2024 at 4:42 PM
"noindex, follow" is the "thoughts and prayers" of technical SEO.
Taylor, WAPO put a NOINDEX tag on the article: <meta name="robots" content="noindex"/>
December 23, 2024 at 5:16 AM
Taylor, WAPO put a NOINDEX tag on the article: <meta name="robots" content="noindex"/>
WAPO has a NOINDEX tag on the page, which asks search engines to NOT crawl it...
<meta name="robots" content="noindex"/>
<meta name="robots" content="noindex"/>
December 23, 2024 at 5:21 AM
WAPO has a NOINDEX tag on the page, which asks search engines to NOT crawl it...
<meta name="robots" content="noindex"/>
<meta name="robots" content="noindex"/>
It has noindex set on the crawler settings so all search engines are ignoring it.
December 23, 2024 at 5:24 AM
It has noindex set on the crawler settings so all search engines are ignoring it.
This article is explicitly set to be avoided by search engine crawlers using a metadata property called “robots” set to “noindex"
It is controlled on WaPo’s end, presumably via their CMS.
It is controlled on WaPo’s end, presumably via their CMS.
December 23, 2024 at 5:18 AM
This article is explicitly set to be avoided by search engine crawlers using a metadata property called “robots” set to “noindex"
It is controlled on WaPo’s end, presumably via their CMS.
It is controlled on WaPo’s end, presumably via their CMS.
It's probably a "noindex" setting, which hides site content from search engines
December 23, 2024 at 5:17 AM
It's probably a "noindex" setting, which hides site content from search engines
Technical SEO tidbit spotted by @rustybrick.com
If you change a robots "noindex" directive to "index" via JavaScript, good chance Google won't ever render the JavaScript after they see the "noindex" in your HTML 🚫
"noindex" in HTML remains noindex
searchengineland.com/google-says-...
If you change a robots "noindex" directive to "index" via JavaScript, good chance Google won't ever render the JavaScript after they see the "noindex" in your HTML 🚫
"noindex" in HTML remains noindex
searchengineland.com/google-says-...
December 15, 2025 at 11:46 PM
Technical SEO tidbit spotted by @rustybrick.com
If you change a robots "noindex" directive to "index" via JavaScript, good chance Google won't ever render the JavaScript after they see the "noindex" in your HTML 🚫
"noindex" in HTML remains noindex
searchengineland.com/google-says-...
If you change a robots "noindex" directive to "index" via JavaScript, good chance Google won't ever render the JavaScript after they see the "noindex" in your HTML 🚫
"noindex" in HTML remains noindex
searchengineland.com/google-says-...
Question appears to be mostly answered: WaPo set it to noindex, effectively telling search engines not to bother. Not sure why, but closing responses to this post because lots of people are starting to weigh in with thoughts on a question already answered.
December 23, 2024 at 6:55 AM
Question appears to be mostly answered: WaPo set it to noindex, effectively telling search engines not to bother. Not sure why, but closing responses to this post because lots of people are starting to weigh in with thoughts on a question already answered.
Betterment was hacked and users' personal data compromised, but you might not know it because the company hid its data breach notice with a "noindex" tag in its web page source code. This tells search engines to ignore the page so people won't see it in search results. techcrunch.com/2026/01/12/f...
January 12, 2026 at 6:24 PM
Betterment was hacked and users' personal data compromised, but you might not know it because the company hid its data breach notice with a "noindex" tag in its web page source code. This tells search engines to ignore the page so people won't see it in search results. techcrunch.com/2026/01/12/f...
Shopify's dirty secret? Index bloat. Duplicate tag pages waste your Google crawl budget and tank your organic rankings.
Stop editing risky theme code. Safely bulk automate "noindex" and reclaim your SEO traffic with RankingRider.
#shopify #seo #buildinpublic #indiedev #rankingrider
Stop editing risky theme code. Safely bulk automate "noindex" and reclaim your SEO traffic with RankingRider.
#shopify #seo #buildinpublic #indiedev #rankingrider
Bulk Automate Shopify Tag Noindex to Fix Bloat: 2026 Guide
RankingRider - Automated SEO Blog
blog.rankingrider.com
June 5, 2026 at 8:01 AM
Shopify's dirty secret? Index bloat. Duplicate tag pages waste your Google crawl budget and tank your organic rankings.
Stop editing risky theme code. Safely bulk automate "noindex" and reclaim your SEO traffic with RankingRider.
#shopify #seo #buildinpublic #indiedev #rankingrider
Stop editing risky theme code. Safely bulk automate "noindex" and reclaim your SEO traffic with RankingRider.
#shopify #seo #buildinpublic #indiedev #rankingrider
Conduent's handling of its data breach has been truly shit, refusing to say how many people are affected, or how the breach occurred.
Conduent hid its breach notice with "noindex" code, so you won't see the page in search results. It doesn't even *mention* a breach! techcrunch.com/2026/02/24/c...
Conduent hid its breach notice with "noindex" code, so you won't see the page in search results. It doesn't even *mention* a breach! techcrunch.com/2026/02/24/c...
February 24, 2026 at 2:18 PM
Conduent's handling of its data breach has been truly shit, refusing to say how many people are affected, or how the breach occurred.
Conduent hid its breach notice with "noindex" code, so you won't see the page in search results. It doesn't even *mention* a breach! techcrunch.com/2026/02/24/c...
Conduent hid its breach notice with "noindex" code, so you won't see the page in search results. It doesn't even *mention* a breach! techcrunch.com/2026/02/24/c...
Do I use robots.txt or noindex to control GoogleBot?
February 6, 2025 at 7:38 PM
Do I use robots.txt or noindex to control GoogleBot?
VxD Discovery Forge · Aggregatore Web
Inserisci un URL: VxD verifica robots, noindex, canonical e metadati, poi crea una scheda…
https://vxd.mobi/seo/forge/forge-d3aaa0395c53
Inserisci un URL: VxD verifica robots, noindex, canonical e metadati, poi crea una scheda…
https://vxd.mobi/seo/forge/forge-d3aaa0395c53
September 26, 2026 at 1:14 PM
VxD Discovery Forge · Aggregatore Web
Inserisci un URL: VxD verifica robots, noindex, canonical e metadati, poi crea una scheda…
https://vxd.mobi/seo/forge/forge-d3aaa0395c53
Inserisci un URL: VxD verifica robots, noindex, canonical e metadati, poi crea una scheda…
https://vxd.mobi/seo/forge/forge-d3aaa0395c53
Google clarifies robots.txt best practices and explains when to use robots.txt directives and noindex tags for SEO via @mattgsouthern.bsky.social
www.searchenginejournal.com/google-on-ro...
www.searchenginejournal.com/google-on-ro...
Google On Robots.txt: When To Use Noindex vs. Disallow
Google clarifies robots.txt best practices and explains when to use robots.txt directives and noindex tags for SEO.
www.searchenginejournal.com
December 4, 2024 at 5:15 PM
Google clarifies robots.txt best practices and explains when to use robots.txt directives and noindex tags for SEO via @mattgsouthern.bsky.social
www.searchenginejournal.com/google-on-ro...
www.searchenginejournal.com/google-on-ro...
Noindex no longer means no render in the Google crawling / indexing pipeline.
Previously, JavaScript wouldn't be executed on pages with a noindex tag on them, that no longer seems to be the case.
I wrote up a quick post about it here: tamethebots.com/blog-n-bits/...
Previously, JavaScript wouldn't be executed on pages with a noindex tag on them, that no longer seems to be the case.
I wrote up a quick post about it here: tamethebots.com/blog-n-bits/...
Noindex No Longer Means Not Rendered
It seems there's been a change in how Google's rendering works when a page is set to noindex, with JavaScript now being executed.
tamethebots.com
June 24, 2025 at 11:57 AM
Noindex no longer means no render in the Google crawling / indexing pipeline.
Previously, JavaScript wouldn't be executed on pages with a noindex tag on them, that no longer seems to be the case.
I wrote up a quick post about it here: tamethebots.com/blog-n-bits/...
Previously, JavaScript wouldn't be executed on pages with a noindex tag on them, that no longer seems to be the case.
I wrote up a quick post about it here: tamethebots.com/blog-n-bits/...
I am once again asking companies to not be absolute shitbags about their data breach disclosures, such as deliberately blocking search engines from seeing the page by using a "noindex" tag in its HTML.
Today's edition: Australian airline Qantas.
My story: techcrunch.com/2025/07/02/q...
Today's edition: Australian airline Qantas.
My story: techcrunch.com/2025/07/02/q...
July 2, 2025 at 12:04 PM
I am once again asking companies to not be absolute shitbags about their data breach disclosures, such as deliberately blocking search engines from seeing the page by using a "noindex" tag in its HTML.
Today's edition: Australian airline Qantas.
My story: techcrunch.com/2025/07/02/q...
Today's edition: Australian airline Qantas.
My story: techcrunch.com/2025/07/02/q...
Medium adds a noindex tag when Google visits your articles..
1/5
1/5
September 28, 2026 at 7:26 AM
Medium adds a noindex tag when Google visits your articles..
1/5
1/5
Sometime between Dec. 18 and 19--when it was under scrutiny about how it would handle the Gaetz report--the House Ethics Committee added a line of code to its website:
<meta name='robots' content='noindex, nofollow' />
That tells search engines not to index the site.
2/
<meta name='robots' content='noindex, nofollow' />
That tells search engines not to index the site.
2/
February 11, 2025 at 7:21 PM
Sometime between Dec. 18 and 19--when it was under scrutiny about how it would handle the Gaetz report--the House Ethics Committee added a line of code to its website:
<meta name='robots' content='noindex, nofollow' />
That tells search engines not to index the site.
2/
<meta name='robots' content='noindex, nofollow' />
That tells search engines not to index the site.
2/
Empty Shopify collections are killing your SEO crawl budget. 🛑
Learn how to bulk noindex them in seconds with a simple Liquid code tweak—and how to easily optimize the rest of your catalog in bulk. 👇
#shopify #seo #buildinpublic #indiedev #rankingrider
Learn how to bulk noindex them in seconds with a simple Liquid code tweak—and how to easily optimize the rest of your catalog in bulk. 👇
#shopify #seo #buildinpublic #indiedev #rankingrider
How to Bulk Noindex Empty Shopify Collections Fast in 2026
RankingRider - Automated SEO Blog
blog.rankingrider.com
May 27, 2026 at 8:08 AM
Empty Shopify collections are killing your SEO crawl budget. 🛑
Learn how to bulk noindex them in seconds with a simple Liquid code tweak—and how to easily optimize the rest of your catalog in bulk. 👇
#shopify #seo #buildinpublic #indiedev #rankingrider
Learn how to bulk noindex them in seconds with a simple Liquid code tweak—and how to easily optimize the rest of your catalog in bulk. 👇
#shopify #seo #buildinpublic #indiedev #rankingrider
If you serve it with 404 you don't need a noindex.
July 27, 2025 at 3:05 PM
If you serve it with 404 you don't need a noindex.
Is your Shopify store bleeding search traffic? Google is wasting your crawl budget on useless duplicate URLs. Stop the manual nightmare. Bulk noindex thousands of junk pages in minutes with RankingRider & reclaim your rankings.
#ShopifySEO #SEO #buildinpublic #indiedev #rankingrider
#ShopifySEO #SEO #buildinpublic #indiedev #rankingrider
How to Bulk Automate Shopify Noindex in 2026: The Smart Way
RankingRider - Automated SEO Blog
blog.rankingrider.com
May 29, 2026 at 8:03 AM
Is your Shopify store bleeding search traffic? Google is wasting your crawl budget on useless duplicate URLs. Stop the manual nightmare. Bulk noindex thousands of junk pages in minutes with RankingRider & reclaim your rankings.
#ShopifySEO #SEO #buildinpublic #indiedev #rankingrider
#ShopifySEO #SEO #buildinpublic #indiedev #rankingrider
Nothing says better "I want to wipe out my site from search" than these bad boys. Ok HTTP status codes do. And "noindex". Connection issues? Ok there are many things.
December 24, 2024 at 12:45 PM
Nothing says better "I want to wipe out my site from search" than these bad boys. Ok HTTP status codes do. And "noindex". Connection issues? Ok there are many things.
