Claude would make it worse, all options are awful.
I also just don't believe that they couldn't find someone who could help or find someone who talked about it online.
If the webscraper found it, it obviously existed.
I also just don't believe that they couldn't find someone who could help or find someone who talked about it online.
If the webscraper found it, it obviously existed.
November 10, 2026 at 8:32 AM
Claude would make it worse, all options are awful.
I also just don't believe that they couldn't find someone who could help or find someone who talked about it online.
If the webscraper found it, it obviously existed.
I also just don't believe that they couldn't find someone who could help or find someone who talked about it online.
If the webscraper found it, it obviously existed.
Scrapers get judged on good days. I timed the bad ones.
The site allows 5 requests per second: Netweir got 200 of 200 pages. Self-hosted Firecrawl got 30, Scrapy 5.
Same settings: 2.6x faster than Scrapy. Both on defaults: 15x faster than Firecrawl.
github.com/netweir/netweir #webscraper #spider
The site allows 5 requests per second: Netweir got 200 of 200 pages. Self-hosted Firecrawl got 30, Scrapy 5.
Same settings: 2.6x faster than Scrapy. Both on defaults: 15x faster than Firecrawl.
github.com/netweir/netweir #webscraper #spider
November 2, 2026 at 2:13 PM
Scrapers get judged on good days. I timed the bad ones.
The site allows 5 requests per second: Netweir got 200 of 200 pages. Self-hosted Firecrawl got 30, Scrapy 5.
Same settings: 2.6x faster than Scrapy. Both on defaults: 15x faster than Firecrawl.
github.com/netweir/netweir #webscraper #spider
The site allows 5 requests per second: Netweir got 200 of 200 pages. Self-hosted Firecrawl got 30, Scrapy 5.
Same settings: 2.6x faster than Scrapy. Both on defaults: 15x faster than Firecrawl.
github.com/netweir/netweir #webscraper #spider
Affirmations for the AI webscraper
October 27, 2026 at 2:15 PM
Affirmations for the AI webscraper
tony hawks pro webscraper
October 11, 2026 at 11:47 PM
tony hawks pro webscraper
No shit! A.I
= Webscraper+Gui
= Webscraper+Gui
can’t think of a better example of AI being mostly a solution to a problem that doesn’t exist
also it can’t help when this is your user base
also it can’t help when this is your user base
October 6, 2026 at 7:53 PM
No shit! A.I
= Webscraper+Gui
= Webscraper+Gui
Like best guess OpenAi deploys some LLM based webscraper to build its own dataset. That scraper interacts with JavaScript elements and treats Login Boxes no different than any other element and attempts to 'complete' them, trying to access more data
September 26, 2026 at 12:10 AM
Like best guess OpenAi deploys some LLM based webscraper to build its own dataset. That scraper interacts with JavaScript elements and treats Login Boxes no different than any other element and attempts to 'complete' them, trying to access more data
Nothing.
Webscraper self-promotion.
Webscraper self-promotion.
September 12, 2026 at 9:45 PM
Nothing.
Webscraper self-promotion.
Webscraper self-promotion.
Does it have a webscraper function? Maybe you can prove it by giving it a URL that defines AI psychosis and gives examples, then it might obey you.
September 10, 2026 at 9:28 AM
Does it have a webscraper function? Maybe you can prove it by giving it a URL that defines AI psychosis and gives examples, then it might obey you.
Custom Python Bot & Business Automation Services
Hire a specialized Python developer for web scraping bots, API integrations, automated data extraction, process automation scripts, and custom utility bots.
go.fiverr.com/visit/?bta=2...
#PythonBot #SoftwareAutomation #WebScraper #PythonDev
Hire a specialized Python developer for web scraping bots, API integrations, automated data extraction, process automation scripts, and custom utility bots.
go.fiverr.com/visit/?bta=2...
#PythonBot #SoftwareAutomation #WebScraper #PythonDev
September 7, 2026 at 11:51 AM
Custom Python Bot & Business Automation Services
Hire a specialized Python developer for web scraping bots, API integrations, automated data extraction, process automation scripts, and custom utility bots.
go.fiverr.com/visit/?bta=2...
#PythonBot #SoftwareAutomation #WebScraper #PythonDev
Hire a specialized Python developer for web scraping bots, API integrations, automated data extraction, process automation scripts, and custom utility bots.
go.fiverr.com/visit/?bta=2...
#PythonBot #SoftwareAutomation #WebScraper #PythonDev
Der wöchentliche Newsletter von heise+ mit den Themen: eSIM, Apple-Watch- und Monitor-Kaufberatung, lokal KI-Bilder generieren sowie Webscraper für Zalando. #Journal
heise+ | heise+ Update vom 9. Mai 2025: Lesetipps fürs Wochenende
Der wöchentliche Newsletter von heise+ mit den Themen: eSIM, Apple-Watch- und Monitor-Kaufberatung, lokal KI-Bilder generieren sowie Webscraper für Zalando.
www.heise.de
May 9, 2025 at 11:34 AM
Der wöchentliche Newsletter von heise+ mit den Themen: eSIM, Apple-Watch- und Monitor-Kaufberatung, lokal KI-Bilder generieren sowie Webscraper für Zalando. #Journal
Sneaker sind teuer. Ein Webscraper erkennt die Tiefpreise. Wir erklären, wie Sie die Daten mit Python ziehen – und Geld sparen. #Programmierung
heise+ | Zalando-Scraper: Schuhe mit Python tracken
Sneaker sind teuer. Ein Webscraper erkennt die Tiefpreise. Wir erklären, wie Sie die Daten mit Python ziehen – und Geld sparen.
www.heise.de
May 7, 2025 at 2:05 PM
Sneaker sind teuer. Ein Webscraper erkennt die Tiefpreise. Wir erklären, wie Sie die Daten mit Python ziehen – und Geld sparen. #Programmierung
I created a secondary profile with a new email account (only for this purpose) a few years back because I was writing a webscraper.
Absolutely zero contacts and friends or any kind of activity. Absolutely empty profile. Recently I deleted that account and the mail account, took a look in the inbo…
Absolutely zero contacts and friends or any kind of activity. Absolutely empty profile. Recently I deleted that account and the mail account, took a look in the inbo…
February 24, 2026 at 10:18 PM
I created a secondary profile with a new email account (only for this purpose) a few years back because I was writing a webscraper.
Absolutely zero contacts and friends or any kind of activity. Absolutely empty profile. Recently I deleted that account and the mail account, took a look in the inbo…
Absolutely zero contacts and friends or any kind of activity. Absolutely empty profile. Recently I deleted that account and the mail account, took a look in the inbo…
Tencent uses a webscraper that uses a generic user-agent, flat out ignores robots.txt and uses different IP addresses for each request.
(In case you're wondering what kind of garbage company you're cheering on.)
(In case you're wondering what kind of garbage company you're cheering on.)
September 1, 2025 at 6:48 PM
Tencent uses a webscraper that uses a generic user-agent, flat out ignores robots.txt and uses different IP addresses for each request.
(In case you're wondering what kind of garbage company you're cheering on.)
(In case you're wondering what kind of garbage company you're cheering on.)
Eu só queria que as pessoas pesquisem "(filme) drive" no youtube e achassem minha conta do bluesky ou o xitter (porque 95% do catalogo n tem em outro lugar em pt) facilmente, mas eu já testei e só funciona no com conta grande (ou seria post antigo? eu sei que o google tem o webscraper dele que demor
October 12, 2024 at 10:46 PM
Eu só queria que as pessoas pesquisem "(filme) drive" no youtube e achassem minha conta do bluesky ou o xitter (porque 95% do catalogo n tem em outro lugar em pt) facilmente, mas eu já testei e só funciona no com conta grande (ou seria post antigo? eu sei que o google tem o webscraper dele que demor
Will technology help revive local news?
.
I tried out a webscraper on my town's website.
It didn't work.
But as technology develops, maybe it could be used to scrape municipal websites for information--agendas, meeting minutes, etc.--and save time on news collection.
.
I tried out a webscraper on my town's website.
It didn't work.
But as technology develops, maybe it could be used to scrape municipal websites for information--agendas, meeting minutes, etc.--and save time on news collection.
November 15, 2024 at 12:15 PM
Will technology help revive local news?
.
I tried out a webscraper on my town's website.
It didn't work.
But as technology develops, maybe it could be used to scrape municipal websites for information--agendas, meeting minutes, etc.--and save time on news collection.
.
I tried out a webscraper on my town's website.
It didn't work.
But as technology develops, maybe it could be used to scrape municipal websites for information--agendas, meeting minutes, etc.--and save time on news collection.
Erstmal einen Webscraper bauen, der die Preise für eine Wunschliste bei einem Händler absaugt und Alarm schlägt, wenn was im Angebot ist.
Nie wieder was verpassen. 😁
Nie wieder was verpassen. 😁
October 6, 2025 at 2:07 PM
Erstmal einen Webscraper bauen, der die Preise für eine Wunschliste bei einem Händler absaugt und Alarm schlägt, wenn was im Angebot ist.
Nie wieder was verpassen. 😁
Nie wieder was verpassen. 😁
April 22, 2025 at 10:11 AM
![==> /var/log/nginx/Foxtanium/archive.hostnetwork.xyz.acces.log <==
192.168.1.101 - - [22/Apr/2025:12:00:40 +0200] "GET /crowbar/Crowbar_2022-08-04_0.72.7z HTTP/2.0" 200 1045259 "-" "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)"](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:xxpsmzuxvfukirgdprln665v/bafkreifcbthxy3yildn2fedzuwjyyawqus67qnszqyzdwxn3m2mkfrme2y)
April 22, 2025 at 10:06 AM
Enunciado y solución de ejercicio resuelto en Python web scraping: proyectoa.com/enunciado-y-...
Enunciado y solución de ejercicios resueltos en Python: web scraping
#pyhton #ejerciciospython #enunciadopython #webscraping #webscraper #bs4 #BeautifulSoup
Enunciado y solución de ejercicios resueltos en Python: web scraping
#pyhton #ejerciciospython #enunciadopython #webscraping #webscraper #bs4 #BeautifulSoup
Enunciado y solución de ejercicio resuelto en Python web scraping » Proyecto A
Enunciado y solución de ejercicios resueltos en Python: web scraping. Se incluye la descarga del código fuente completo de los ejercicios en Python. Se pedirá que se desarrolle un programa Python que ...
proyectoa.com
December 11, 2024 at 6:54 PM
Enunciado y solución de ejercicio resuelto en Python web scraping: proyectoa.com/enunciado-y-...
Enunciado y solución de ejercicios resueltos en Python: web scraping
#pyhton #ejerciciospython #enunciadopython #webscraping #webscraper #bs4 #BeautifulSoup
Enunciado y solución de ejercicios resueltos en Python: web scraping
#pyhton #ejerciciospython #enunciadopython #webscraping #webscraper #bs4 #BeautifulSoup
Any developers out there familiar with Sentiment Analysis? Particularly for large platforms such as “broken-Twitter”, Rumble, OpenWeb?
Would love to be able to get a pulse on each of the digital herds over time.
#Developers #SentimentAnalysis #LLM #FullStack #Scraping #WebScraper #DataAnalysis
Would love to be able to get a pulse on each of the digital herds over time.
#Developers #SentimentAnalysis #LLM #FullStack #Scraping #WebScraper #DataAnalysis
February 11, 2025 at 8:44 PM
Any developers out there familiar with Sentiment Analysis? Particularly for large platforms such as “broken-Twitter”, Rumble, OpenWeb?
Would love to be able to get a pulse on each of the digital herds over time.
#Developers #SentimentAnalysis #LLM #FullStack #Scraping #WebScraper #DataAnalysis
Would love to be able to get a pulse on each of the digital herds over time.
#Developers #SentimentAnalysis #LLM #FullStack #Scraping #WebScraper #DataAnalysis
webscraper cloud、基本的にはブラウザのプラグインで設定したサイトマップをJSONでエクスポートしてテキストデータとしてcloud側に貼ってインポートして使うしかなく、しかも一度読み込んだらそっちではビタイチサイトマップを編集できないという、ぜんぜん「今時のクラウド」じゃない無骨さ・スパルタンさがある。
実質的に「ロボット避けにIPアドレスを切り替えながらスクレイピングする機能」だけがクラウド版の提供価値だと割り切ってて、実際これまでwebscraper使ってたユーザーの方もそれで充分満足だということですね
実質的に「ロボット避けにIPアドレスを切り替えながらスクレイピングする機能」だけがクラウド版の提供価値だと割り切ってて、実際これまでwebscraper使ってたユーザーの方もそれで充分満足だということですね
December 20, 2023 at 1:38 AM
webscraper cloud、基本的にはブラウザのプラグインで設定したサイトマップをJSONでエクスポートしてテキストデータとしてcloud側に貼ってインポートして使うしかなく、しかも一度読み込んだらそっちではビタイチサイトマップを編集できないという、ぜんぜん「今時のクラウド」じゃない無骨さ・スパルタンさがある。
実質的に「ロボット避けにIPアドレスを切り替えながらスクレイピングする機能」だけがクラウド版の提供価値だと割り切ってて、実際これまでwebscraper使ってたユーザーの方もそれで充分満足だということですね
実質的に「ロボット避けにIPアドレスを切り替えながらスクレイピングする機能」だけがクラウド版の提供価値だと割り切ってて、実際これまでwebscraper使ってたユーザーの方もそれで充分満足だということですね