I've added video support to my "shot-scraper" browser automation tool - you (or your coding agent) can now create a storyboard YAML file and use that to record a video demo of new web application features simonwillison.net/2026/Jun/30/...
Have your agent record video demos of its work with shot-scraper video
shot-scraper video is a new command introduced in today’s shot-scraper 1.10 release which accepts a storyboard.yml file defining a routine to run against a web application and uses Playwright to …
simonwillison.net
June 30, 2026 at 4:56 PM
I've added video support to my "shot-scraper" browser automation tool - you (or your coding agent) can now create a storyboard YAML file and use that to record a video demo of new web application features simonwillison.net/2026/Jun/30/...
New release of shot-scraper with the ability to conveniently run scripts shared on GitHub against web pages in a headless browser simonwillison.net/2025/Mar/25/...
March 25, 2025 at 2:27 AM
New release of shot-scraper with the ability to conveniently run scripts shared on GitHub against web pages in a headless browser simonwillison.net/2025/Mar/25/...
New release of shot-scraper, adding support for HTTP Archives. You can now run:
shot-scraper har datasette.io
And get back a JSON datasette-io.har file containing all of the requests and responses used to render that page.
Lots more details here: simonwillison.net/2025/Feb/13/...
shot-scraper har datasette.io
And get back a JSON datasette-io.har file containing all of the requests and responses used to render that page.
Lots more details here: simonwillison.net/2025/Feb/13/...
shot-scraper 1.6 with support for HTTP Archives
New release of my [shot-scraper](https://shot-scraper.datasette.io/) CLI tool for taking screenshots and scraping web pages. The big new feature is [HTTP Archive (HAR)](https://en.wikipedia.org/wiki/H...
simonwillison.net
February 13, 2025 at 9:04 PM
New release of shot-scraper, adding support for HTTP Archives. You can now run:
shot-scraper har datasette.io
And get back a JSON datasette-io.har file containing all of the requests and responses used to render that page.
Lots more details here: simonwillison.net/2025/Feb/13/...
shot-scraper har datasette.io
And get back a JSON datasette-io.har file containing all of the requests and responses used to render that page.
Lots more details here: simonwillison.net/2025/Feb/13/...
Latest edition of my newsletter covers OpenAI audio, o1-pro, Claude web search, DeepSeek-V3-0324, Qwen2.5-VL-32B, Playwright MCP and shot-scraper 1.8 simonw.substack.com/p/new-audio-...
New audio models from OpenAI, but how much can we rely on them?
Plus o1-pro, Claude web search, DeepSeek-V3-0324, Qwen2.5-VL-32B and a new shot-scraper
simonw.substack.com
March 25, 2025 at 4:27 AM
Latest edition of my newsletter covers OpenAI audio, o1-pro, Claude web search, DeepSeek-V3-0324, Qwen2.5-VL-32B, Playwright MCP and shot-scraper 1.8 simonw.substack.com/p/new-audio-...
December 22, 2024 at 4:40 PM
450 Sutterscape
One of my favorite buildings in San Fransisco for #abstractia #architecture and #scape day.
#EastCoastKin #ECK #ArtYear
One of my favorite buildings in San Fransisco for #abstractia #architecture and #scape day.
#EastCoastKin #ECK #ArtYear
April 3, 2026 at 6:01 PM
450 Sutterscape
One of my favorite buildings in San Fransisco for #abstractia #architecture and #scape day.
#EastCoastKin #ECK #ArtYear
One of my favorite buildings in San Fransisco for #abstractia #architecture and #scape day.
#EastCoastKin #ECK #ArtYear
I have discovered Sty scraper so that’s my productivity shot for the next 2-3 weeks
March 5, 2025 at 3:54 PM
I have discovered Sty scraper so that’s my productivity shot for the next 2-3 weeks
Here's an example, recorded by "shot-scraper video" using a YAML storyboard constructed by Codex Desktop and GPT-5.5 xhigh
June 30, 2026 at 4:57 PM
Here's an example, recorded by "shot-scraper video" using a YAML storyboard constructed by Codex Desktop and GPT-5.5 xhigh
Ugh, another content scraper to block. There are TONS of real nature photographers posting their own work here. Please enjoy their photos instead! These accounts rack up followers and then often sell the account off or otherwise make money from stolen work, so it's best not to support them.
October 11, 2023 at 2:26 PM
Ugh, another content scraper to block. There are TONS of real nature photographers posting their own work here. Please enjoy their photos instead! These accounts rack up followers and then often sell the account off or otherwise make money from stolen work, so it's best not to support them.
Shout out to @simonwillison.net ’s shot-scraper for grabbing web browser screenshots from the command line.
I redid dozens of screenshots for the upcoming book update, and shot-scraper made it way easier than my previous approach with Firefox’s screenshot tool.
shot-scraper.datasette.io/en/stable/
I redid dozens of screenshots for the upcoming book update, and shot-scraper made it way easier than my previous approach with Firefox’s screenshot tool.
shot-scraper.datasette.io/en/stable/
shot-scraperContentsMenuExpandLight modeDark modeAuto light/dark mode
shot-scraper.datasette.io
November 13, 2024 at 9:24 PM
Shout out to @simonwillison.net ’s shot-scraper for grabbing web browser screenshots from the command line.
I redid dozens of screenshots for the upcoming book update, and shot-scraper made it way easier than my previous approach with Firefox’s screenshot tool.
shot-scraper.datasette.io/en/stable/
I redid dozens of screenshots for the upcoming book update, and shot-scraper made it way easier than my previous approach with Firefox’s screenshot tool.
shot-scraper.datasette.io/en/stable/
Generation Toy Scraper aka Constructicon Scrapper - Robot Mode
October 11, 2023 at 8:13 AM
Generation Toy Scraper aka Constructicon Scrapper - Robot Mode
Bleh, frog content scraper account to report and block. They're new so hopefully we can nip their influence in the bud.
@franzanth.bsky.social
@franzanth.bsky.social
September 25, 2024 at 10:24 PM
Bleh, frog content scraper account to report and block. They're new so hopefully we can nip their influence in the bud.
@franzanth.bsky.social
@franzanth.bsky.social
As with almost every live demo at #NICAR, my tutorial on using shot-scraper to scrape tricky websites had some issues on Saturday. I *think* I've cleaned them up.
github.com/dwillis/shot...
github.com/dwillis/shot...
GitHub - dwillis/shot-scraper-nicar24
Contribute to dwillis/shot-scraper-nicar24 development by creating an account on GitHub.
github.com
March 11, 2024 at 12:02 AM
As with almost every live demo at #NICAR, my tutorial on using shot-scraper to scrape tricky websites had some issues on Saturday. I *think* I've cleaned them up.
github.com/dwillis/shot...
github.com/dwillis/shot...
spider-man licensed games, print ad (1992) archive.org/details/nint...
October 28, 2025 at 9:36 AM
spider-man licensed games, print ad (1992) archive.org/details/nint...
New release of shot-scraper with the ability to conveniently run scripts shared on GitHub against web pages in a headless browser https://simonwillison.net/2025/Mar/25/shot-scraper/
March 25, 2025 at 2:28 AM
New release of shot-scraper with the ability to conveniently run scripts shared on GitHub against web pages in a headless browser https://simonwillison.net/2025/Mar/25/shot-scraper/
Here's another content scraper to report and block! They're following tons of people in an attempt to get follow-backs, a thing these accounts often do. They usually sell off the accounts later or make money in other ways off of real people's work.
May 30, 2024 at 5:13 PM
Here's another content scraper to report and block! They're following tons of people in an attempt to get follow-backs, a thing these accounts often do. They usually sell off the accounts later or make money in other ways off of real people's work.
January 27, 2025 at 7:02 AM
New release of shot-scraper - my browser automation CLI tool for taking screenshots, scraping web pages with JavaScript and more https://github.com/simonw/shot-scraper/releases/tag/1.2
April 27, 2023 at 3:07 AM
New release of shot-scraper - my browser automation CLI tool for taking screenshots, scraping web pages with JavaScript and more https://github.com/simonw/shot-scraper/releases/tag/1.2
Many if not most viral cloud images are stolen from photographers. I remember in 2022 a storm chaser caught an amazing shot. Some scraper account posted it and got 25K like and millions and millions of views. The photographer's original post got about 600 likes.
September 4, 2024 at 5:13 PM
Many if not most viral cloud images are stolen from photographers. I remember in 2022 a storm chaser caught an amazing shot. Some scraper account posted it and got 25K like and millions and millions of views. The photographer's original post got about 600 likes.
🤖 Agent Demo Creation Gets Easier with Shot-Scraper Video
Developers are increasingly using automated tools like Shot Scraper to create video demos of AI agents' work, reducing manual effort. The new shot scraper video command...
#AIInference #DeepLearning #Performance #AI #AIPulse
Developers are increasingly using automated tools like Shot Scraper to create video demos of AI agents' work, reducing manual effort. The new shot scraper video command...
#AIInference #DeepLearning #Performance #AI #AIPulse
Read the full article →
www.synestesia.uk
July 2, 2026 at 9:38 AM
🤖 Agent Demo Creation Gets Easier with Shot-Scraper Video
Developers are increasingly using automated tools like Shot Scraper to create video demos of AI agents' work, reducing manual effort. The new shot scraper video command...
#AIInference #DeepLearning #Performance #AI #AIPulse
Developers are increasingly using automated tools like Shot Scraper to create video demos of AI agents' work, reducing manual effort. The new shot scraper video command...
#AIInference #DeepLearning #Performance #AI #AIPulse
SKY THE SCRAPER drops July 30 on Steam!
For this occasion, we shot a live-action trailer with a real skyscraper cleaner and a close friend of solo dev Ryo Kobuchi.
Get a glimpse of the real grind: youtu.be/zadF46OJY_8
#HYPERREAL #SKYTHESCRAPER #indiegames #indiedev #gamedev #upcominggames
For this occasion, we shot a live-action trailer with a real skyscraper cleaner and a close friend of solo dev Ryo Kobuchi.
Get a glimpse of the real grind: youtu.be/zadF46OJY_8
#HYPERREAL #SKYTHESCRAPER #indiegames #indiedev #gamedev #upcominggames
SKY THE SCRAPER｜発売日発表 実写トレーラー
YouTube video by HYPER REAL
youtu.be
July 9, 2025 at 6:52 AM
SKY THE SCRAPER drops July 30 on Steam!
For this occasion, we shot a live-action trailer with a real skyscraper cleaner and a close friend of solo dev Ryo Kobuchi.
Get a glimpse of the real grind: youtu.be/zadF46OJY_8
#HYPERREAL #SKYTHESCRAPER #indiegames #indiedev #gamedev #upcominggames
For this occasion, we shot a live-action trailer with a real skyscraper cleaner and a close friend of solo dev Ryo Kobuchi.
Get a glimpse of the real grind: youtu.be/zadF46OJY_8
#HYPERREAL #SKYTHESCRAPER #indiegames #indiedev #gamedev #upcominggames
Latest edition of my newsletter covers OpenAI audio, o1-pro, Claude web search, DeepSeek-V3-0324, Qwen2.5-VL-32B, Playwright MCP and shot-scraper 1.8 https://simonw.substack.com/p/new-audio-models-from-openai-but
New audio models from OpenAI, but how much can we rely on them?
Plus o1-pro, Claude web search, DeepSeek-V3-0324, Qwen2.5-VL-32B and a new shot-scraper
simonw.substack.com
March 25, 2025 at 5:03 AM
Latest edition of my newsletter covers OpenAI audio, o1-pro, Claude web search, DeepSeek-V3-0324, Qwen2.5-VL-32B, Playwright MCP and shot-scraper 1.8 https://simonw.substack.com/p/new-audio-models-from-openai-but
FYI: @simonwillison.net noticed this too and immediately went to try it out:
"A shot-scraper-style JSON API on Bun 1.4's new Bun.WebView"
-> simonwillison.net/2026/Aug/20/...
"A shot-scraper-style JSON API on Bun 1.4's new Bun.WebView"
-> simonwillison.net/2026/Aug/20/...
Research: A shot-scraper-style JSON API on Bun 1.4's new Bun.WebView
A zero-dependency, roughly 150-line TypeScript service demonstrates that Bun 1.4’s experimental `Bun.WebView` can provide a shot-scraper-style JSON API for JavaScript evaluation and PNG/JPEG/WebP scre...
simonwillison.net
August 26, 2026 at 7:14 PM
FYI: @simonwillison.net noticed this too and immediately went to try it out:
"A shot-scraper-style JSON API on Bun 1.4's new Bun.WebView"
-> simonwillison.net/2026/Aug/20/...
"A shot-scraper-style JSON API on Bun 1.4's new Bun.WebView"
-> simonwillison.net/2026/Aug/20/...
(Scraper for you guys to block, saw at least two photos that I recognized from other accounts with the captions directly stolen as well.)
December 17, 2024 at 4:22 AM
(Scraper for you guys to block, saw at least two photos that I recognized from other accounts with the captions directly stolen as well.)
He was in the glove compartment with the road maps and the ice scraper.
October 21, 2025 at 5:18 PM
He was in the glove compartment with the road maps and the ice scraper.