folks don't know that AIs scraping websites accounts for like half of all internet bandwidth usage right now. Sites get scraped- ie, all the contents downloaded- over and over again, destroying/wasting their bandwidth, often maxing it out. It's like being continually DDOS'd
It's a counterattack for AI companies that persistently scrape and rescrape your web site, even when you tell them not to
when a scraper grabs it, it becomes a 10-gig HTML page and 💣 goes the scraper
Item #6 in my latest "Linkfest" newsletter: buttondown.com/clivethompso...
folks don't know that AIs scraping websites accounts for like half of all internet bandwidth usage right now. Sites get scraped- ie, all the contents downloaded- over and over again, destroying/wasting their bandwidth, often maxing it out. It's like being continually DDOS'd
The outages aren't us. One of our bandwidth providers apparently got their fiber cable cut and has been on/off all day
The outages aren't us. One of our bandwidth providers apparently got their fiber cable cut and has been on/off all day
The team is rapidly deploying fixes and new software to adapt. More servers in the mail.
... aaaand it's eaten into our annual bandwidth cap.
Whoops.
... aaaand it's eaten into our annual bandwidth cap.
Whoops.