#webscraping
LightNews LightNews
altidae.bsky.social
that also seems to be directing people to viewpoints about webscraping being positive, that also seems to be directing people to webscraped sites, security hazards, and a site that appears to have been made in Claude that ALSO asks for your ao3 email...l
November 2, 2026 at 3:48 PM
martintale.com
Hit my Cloudflare quota thanks to some useless scraper or bot 😅

#buildinpublic #cloudflare #IndieDev #SoloDev #Serverless #WebDev #SelfHosting #DevOps #IndieHackers #Bots #WebScraping
Bar chart of invocations over the last 24 hours, 235k total. Counts stay under 1k except for a spike of roughly 18k to 24k per bar between about Nov 4, 05:00 and 07:30.
November 4, 2026 at 2:06 PM
newsmason.bsky.social
#trends today for 'sri lanka' 'qualifying offers' & 'web scraping'

Click/Tap below:

www.newsmason.com?query=%22sri...

www.newsmason.com?query=%22qua...

www.newsmason.com?query=%22web...

#srilanka #qualifyingoffers #webscraping
www.newsmason.com
November 3, 2026 at 3:26 AM
petigrusghost.bsky.social
Yes, indeedy. Webscraping with a conversational interface.
mayor.nyc.gov Mayor Zohran Kwame Mamdani @mayor.nyc.gov · 2d
Google is trying to use its monopoly power to force AI into our public schools.

No corporation should have the power to dictate how we teach our children. 

Our public schools exist to serve students, not to grow the profit margins of Big Tech.
Google Will Turn Off Search for Schools That Reject A.I.
Google is making it easier to restrict its A.I. tools for students. But schools that block A.I. entirely will lose student access to Google’s search engine.
www.nytimes.com
November 3, 2026 at 7:22 PM
bsky.scrapers.lat
Discover your competitors' tech stack with our Website Tech Stack Scraper! Extract detailed profiles on CMS, analytics, ecommerce, and more. Perfect for marketers and developers. #TechStack #WebScraping
https://scrapers.lat/go/hiqxyls
November 4, 2026 at 9:04 AM
bsky.scrapers.lat
Need reliable Wikipedia data? Our scraper captures article summaries, metadata, and pageviews for trend analysis. Perfect for researchers and analysts. #WebScraping #DataAnalysis
https://scrapers.lat/go/4auglq
November 4, 2026 at 9:09 PM
bsky.scrapers.lat
Want to gather job postings from Latin American companies on Lever? Discover how to efficiently set up and run your own Lever Job Postings Scraper. #WebScraping #JobTech #LatinAmerica
https://scrapers.lat/go/628maec
November 5, 2026 at 12:24 PM
proxymint.com
getting 429s, so you bought more proxies, and the 429s came back anyway? a target's limit covers the whole job. a 429 in your pilot means slow down or stop, adding IPs doesn't buy you more pace. #webscraping
November 5, 2026 at 12:00 PM
bsky.scrapers.lat
Discover top VS Code publishers by extension installs! Extract domain leads, verification flags, total installs, and more. Ideal for devs and marketers seeking data-driven insights. #VSCMarketplace #WebScraping
https://scrapers.lat/go/ghque
November 3, 2026 at 5:04 AM
bsky.scrapers.lat
Looking to gain a competitive edge in the Australian real estate market? Learn how to scrape valuable property and agent data from Domain.com.au for your market analysis. #RealEstateData #WebScraping
https://scrapers.lat/go/jyo8s4
November 3, 2026 at 7:34 PM
hirobyl.bsky.social
Scrape, crawl, extract, and search the web without building your entire scraping stack.
WebClaw brings multiple web data tools together through one API, with MCP support for AI agents.
See its features and pricing 👇
cutt.ly/6yUpWk1o
#webclaw #AIAgents #thelostoffer #WebScraping
October 31, 2026 at 9:55 AM
bsky.scrapers.lat
Looking to access detailed real estate data from Funda? Learn how to scrape listings for prices, locations, and property types in the Netherlands. Perfect for agents and market analysts. #WebScraping #RealEstateData #Funda
https://scrapers.lat/go/h6z8yvu
November 4, 2026 at 7:39 PM
progressone.bsky.social
🤖 Professional Bots for Automation & More!

Custom Telegram, Discord, WhatsApp bots, web scrapers & API automations in Python.

⭐ 4.9 (45 reviews) · 3 orders in queue · From $90 · Level 2

go.fiverr.com/visit/?bta=2...

#Bots #Automation #PythonBots #TelegramBot #WebScraping
November 4, 2026 at 8:23 PM
bsky.scrapers.lat
Discover how to scrape real estate listings from Dot Property and automate the data into your spreadsheets or CRM. Perfect for property managers in Thailand, the Philippines, and Indonesia. #WebScraping #RealEstateData #Automation
https://scrapers.lat/go/d8w0qe
November 4, 2026 at 12:34 PM
bsky.scrapers.lat
Need structured data from Wasi real estate sites? Our scraper extracts metadata, coordinates, image galleries, and more for property analysis. Ideal for real estate analysts and developers. #WebScraping #RealEstateData
https://scrapers.lat/go/j8gby
November 3, 2026 at 5:04 PM
bsky.scrapers.lat
Need accurate contact info for B2B outreach? Our Website Contact & Email Scraper extracts emails, phone numbers, social profiles, and more from company sites. Perfect for marketers and sales teams. #WebScraping #DataEnrichment
https://scrapers.lat/go/ojs6zyu
November 4, 2026 at 1:04 AM
retailgators.bsky.social
📊 eCommerce & #RetailDataExtraction turns marketplace information into structured business intelligence.

🛒 Product data
💰 Competitor pricing
⭐ Reviews & ratings
🏪 Seller information
📦 Inventory availability
🏷️ Promotions

www.retailgators.com/ecommerce-an...

#eCommerceData #WebScraping
November 3, 2026 at 10:10 AM
proxymint.com
got a proxy list as host:port:user:pass and your tool wants socks5h:// URLs or Playwright settings? we made a converter that runs in your browser and sends nothing anywhere. https://proxymint.com/tools/proxy-format/ #python #webscraping
October 31, 2026 at 12:00 PM
aidailypost.com
New tool WebAnything lets AI agents browse, verify & harvest web data for training—think Qwen3.5‑9B powering smarter WebArena bots. Curious how it reshapes web navigation and scraping? Dive in! #WebAnything #AIAgents #WebScraping

🔗 aidailypost.com/news/webanyt...
October 31, 2026 at 4:22 AM
theunrepentables.bsky.social
steampunk-explorer.com/news/new-met... New Meta Commercial Terms raise questions for Steampunk Creators #Meta #MetaCommercialTerms #Steampunk #SteampunkCreators #Webscraping #ContentScraping #AITraining #NoOptOut #cdnpoli #AllBusinessUsersOnMeta #MetaBusinessUsers
New Meta Commercial Terms Raise Questions for Steampunk Creators
Updated: Meta is drawing heated criticism due to commercial terms that authorize the company to scrape business users’ web pages for product development. The Steampunk Explorer provided the tip that ...
steampunk-explorer.com
November 1, 2026 at 8:45 PM
proxymint.com
moved your scraper to IPv6 proxies for the billions of addresses, and the 429s show up at the same count as before? plenty of rate limiters count a whole /64 as one client. the pool is a lot smaller than the number on the box. #webscraping
November 2, 2026 at 12:00 PM
zytedata.bsky.social
AI changes extraction, adaptation and the cost of adding a source. It does not change access. What is genuinely different, with the arithmetic. https://zpr.io/DRGH4CsiXh2N

#webscraping #webdata #web #data #zyte
AI web scraping and scalable data collection
AI changes extraction, adaptation and the cost of adding a source. It does not change access. What is genuinely different, with the arithmetic.
zpr.io
November 2, 2026 at 8:39 AM
zytedata.bsky.social
Build a RAG pipeline that survives bot blocks and JavaScript pages: fetch LLM-ready Markdown with Zyte API, gate bad pages, and test it before deploying. https://zpr.io/Y9chvGX3cmzz

#webscraping #webdata #web #data #zyte
How to get uninterrupted web data for your RAG pipelines using Zyte API, Qdrant and LangChain?
Build a RAG pipeline that survives bot blocks and JavaScript pages: fetch LLM-ready Markdown with Zyte API, gate bad pages, and test it before deploying.
zpr.io
November 5, 2026 at 7:47 AM
zytedata.bsky.social
Before you write a scraper, use Chrome or Firefox DevTools to find where the data lives, test selectors, check whether JavaScript is involved and spot the requests worth copying. https://zpr.io/QGHYFuichJcd

#webscraping #webdata #web #data #zyte
How to use browser DevTools for web scraping
Before you write a scraper, use Chrome or Firefox DevTools to find where the data lives, test selectors, check whether JavaScript is involved and spot the requests worth copying.
zpr.io
November 3, 2026 at 9:03 AM
aidailypost.com
New tool WebAnything lets AI agents browse, verify & harvest web data for training—think Qwen3.5‑9B powering smarter WebArena bots. Curious how it reshapes web navigation and scraping? Dive in! #WebAnything #AIAgents #WebScraping

🔗 aidailypost.com/news/webanyt...
October 31, 2026 at 4:22 AM