#useragent
Mit lynx -useragent="Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120 Safari/537.36" könnte ich zwar lügen, das hilft aber nur begrenzt weiter, weil dann wird Javascript verlangt. Niemand mag mehr standkonformes HTML ausliefern ohne Javascript.
November 11, 2026 at 8:55 PM
📦 mimmi20/ua-result 17.0.3

Library to handle useragent parser results

🔗 https://github.com/mimmi20/ua-result
November 6, 2026 at 6:59 AM
I imagine the talented @tamethebots.com might have thoughts on this. I've never done it but I imagine there's some kind of useragent detection (spoofing?) that might be required... perhaps.
November 4, 2026 at 8:28 AM
Well, the scraper botnet with no pattern of IP addresses or useragent decided to declare war on my tiny gitbucket instance, so that's another thing I've taken offline.

I think it might be time to arrange an orderly shutdown of this mastodon instance and then just close ports to the outside […]
Original post on jauntygoat.net
jauntygoat.net
November 6, 2026 at 2:35 AM
DuckDuckGoで「useragent」と検索したら、ブラウザの情報が見れた :tatupu_checking:
November 2, 2026 at 7:57 AM
📦 mimmi20/ua-data-mapper 6.0.27

a class to map the results of different useragent parsers

🔗 https://github.com/mimmi20/ua-data-mapper
November 2, 2026 at 7:17 AM
Faking Googlebot takes 30 seconds, Google's Gary Illyes says #Googlebot #SEO #DigitalMarketing #WebSecurity #UserAgent
Faking Googlebot takes 30 seconds, Google's Gary Illyes says
Site owners trusting user-agent headers can't spot impostors, and Google signs only some Google-Agent requests. Could a bot reputation system close that gap?
ppc.land
October 31, 2026 at 9:22 PM
Still have to set up a UserAgent override, to stop some display strangeness whereby the page was three times the width of the screen, but that's minor.

2/2
October 30, 2026 at 9:33 AM
📦 mimmi20/ua-result 17.0.2

Library to handle useragent parser results

🔗 https://github.com/mimmi20/ua-result
October 25, 2026 at 2:00 PM
📦 mimmi20/ua-result 17.0.0

Library to handle useragent parser results

🔗 https://github.com/mimmi20/ua-result
October 25, 2026 at 10:19 AM
The host has never deleted DNS records for closed schools before - just taken their website into 'Maintenance Mode'.

Tonight they deleted the DNS record.
Presumably because a UserAgent reading "d3archive.com missing-file recovery/1.0" was crawling the domain.

I don’t know how to process that.
-30-
October 24, 2026 at 6:04 AM
Blocking a single AI crawler in robots.txt

robots.txt is group-based: a bot obeys the group that names it. To block one AI crawler and keep the rest, give that crawler its own User-agent line with Disallow: /, and leave the User-a… #robotstxt #AICrawlers #useragent #crawlControl #AumCrawl
October 23, 2026 at 3:33 AM
Cloudflare graphs of bot traffic will be from scanning with "useragent: yandexBot/1.2" or similar. Malicious bots don't make themselves known in that way.

That isn't to say malicious traffic hasn't reduced.
October 11, 2026 at 8:44 PM
あくまでケースの一部だろうけど、useragentの値を特に気にしてない人たちもいるのか。
と、思ったがアクセスできるならそれでいいやという話か、とも思った。
October 8, 2026 at 12:51 PM
Extension Releases/Support • Re: Replace All Google "goto" URLs with Real URLs
> An alternative approach also does exist. > > For different browsers Google returns Search results pages of different designs. And its choice depends on a "useragent" request header. For example, Iceape by default uses general.useragent.override.google.com = Mozilla/5.0 (%OS_SLICE% rv:71.0) Gecko/20100101 Firefox/71.0 Basilisk/52.9.20260924, and in this case Google returns pages with links that contain plain text URLs ... I don't think it will be long before Google will have finished implementing "goto" URLs everywhere, without exception: > Google has confirmed it is rolling out new “technical measures” to protect against abuse of its search results and protect its services. Google is rolling out the addition of goto URL parameter redirects to the links in its search results. > > What Google said. A Google spokesperson told us: > > “We have a long history of deploying technical measures against evolving forms of abuse, and we regularly take steps to protect our services and users.” https://searchengineland.com/google-confirms-deploying-goto-url-redirects-to-search-results-links-485926 > Rollout timeline > > The change built up over roughly four months instead of appearing all at once. Early reports were inconsistent. Some testers saw goto links right away while others couldn't reproduce them on the same day. That pattern usually points to a staged rollout, split by IP type or account signals, rather than a single global switch. > > • June 23, 2026: Alex Greenland posts the first public sighting of the goto link format on X. > • July 2, 2026: Brodie Clark documents the pattern across organic and paid listings on SERP Alert, and notes Ahrefs picking up the same pattern in its own tracking. > • Early August 2026: The pattern becomes widely visible across search results, according to Nozzle. > • August 26, 2026: Derek Perkins reports near full rollout across residential IP providers, and Google confirms the change to Search Engine Roundtable. > > Through most of the test window, the share of affected pages stayed low enough for tools like Nozzle to simply discard goto-only pages and refetch them. By August 26, that workaround stopped working, because most pages coming back were goto pages. https://decodo.com/blog/google-goto-redirect-links * * *
forum.palemoon.org
October 4, 2026 at 1:03 AM
Extension Releases/Support • Re: Replace All Google "goto" URLs with Real URLs
> For different browsers Google returns Search results pages of different designs. And its choice depends on a "useragent" request header. For example, Iceape by default uses general.useragent.override.google.com = Mozilla/5.0 (%OS_SLICE% rv:71.0) Gecko/20100101 Firefox/71.0 Basilisk/52.9.20260924, and in this case Google returns pages with links that contain plain text URLs: I tried this extension when it was first released, but PM gave me the plain URL (via q=); went to try it in a new Basilisk profile, but I was getting direct links; few days later they're now giving goto URLs. Tried the above agent in the new Basilisk profile, but still got encrypted links (not goto, but still url=CAES...). Rather than the extension, I use a userscript to convert them automatically. CODE: // ==UserScript==// @name Direct Google// @namespace http://userscripts.org/users/92143// @version 3.1// @description Follows Google goto URLs.// @include /^https?\:\/\/(www|news|maps|docs|cse|encrypted)\.google\./// @author zanetu, adoxa// @license GPL version 2 or any later version; http://www.gnu.org/licenses/gpl-2.0.txt// @grant none// @run-at document-end// ==/UserScript==// 2026-08-27: The original script stopped working, this is basically a rewrite.// 2206-09-09: Didn't last long, URLs have been removed.// 2026-09-20: Remove jQuery (wanted to follow goto URLs, but doesn't look possible without really following it).// 2026-09-29: Fetch "data-sb", which has the URL without redirecting (thanks to tellu-white).function modifyGoogle() {document.querySelectorAll('a[data-sb]').forEach(async function(a) {let url = a.getAttribute('data-sb')// Removing this prevents a listener modifying it.a.removeAttribute('data-sb')if (url.includes("uoh=2")) {let response = await fetch(url)if (response.ok) {let body = await response.text()let redirectUrl = /Url=('.*?')/.exec(body)if (redirectUrl) {a.href = eval(redirectUrl[1]) }}}})}var observer = new window.MutationObserver(function(mutations) {modifyGoogle()})//tiny delay needed for firefoxsetTimeout(function() {observer.observe(document.body, {childList: true, subtree: true})modifyGoogle()}, 100) (Initially the original URLs were still included within JSON data, that's what didn't last long.) * * *
forum.palemoon.org
October 4, 2026 at 1:02 AM
hear me out, godot has it's own language. can render windows, and full, native, 2d rendering and separate, native, 3d rendering. it includes tools for audio, networking (websockets, full udp/tcp server client impl, full http useragent), it can *load gdextensions at runtime* it is an OS.
October 2, 2026 at 9:37 PM