The awesome team at @gradle.com have taken my blog posts and Opinions about Flaky Tests and put them all together in a very wonderful white paper!
Whether you care about #FlakyTests or think you don't have them, there's something in here for you.
#DeveloperProductivity #TestAutomation
Whether you care about #FlakyTests or think you don't have them, there's something in here for you.
#DeveloperProductivity #TestAutomation
The Productive Developer’s Guide to Flaky Tests
Learn practical strategies for minimizing the negative impact of flaky tests and fostering a culture of test reliability.
gradle.com
May 28, 2025 at 9:22 AM
The awesome team at @gradle.com have taken my blog posts and Opinions about Flaky Tests and put them all together in a very wonderful white paper!
Whether you care about #FlakyTests or think you don't have them, there's something in here for you.
#DeveloperProductivity #TestAutomation
Whether you care about #FlakyTests or think you don't have them, there's something in here for you.
#DeveloperProductivity #TestAutomation
Are #FlakyTests disrupting your CI/CD pipeline & draining Developer Productivity?
@trishagee.bsky.social dives deep into the hidden impact of these non-deterministic tests.
@trishagee.bsky.social dives deep into the hidden impact of these non-deterministic tests.
April 18, 2025 at 9:13 AM
Are #FlakyTests disrupting your CI/CD pipeline & draining Developer Productivity?
@trishagee.bsky.social dives deep into the hidden impact of these non-deterministic tests.
@trishagee.bsky.social dives deep into the hidden impact of these non-deterministic tests.
How to Debug Flaky Tests in Playwright | Run Tests Multiple Times
#Playwright #Testing #Automation #SoftwareTesting #Debugging #QA #FlakyTests #JavaScript #WebTesting #TestAutomation #Coding
#Playwright #Testing #Automation #SoftwareTesting #Debugging #QA #FlakyTests #JavaScript #WebTesting #TestAutomation #Coding
February 4, 2025 at 9:00 AM
How to Debug Flaky Tests in Playwright | Run Tests Multiple Times
#Playwright #Testing #Automation #SoftwareTesting #Debugging #QA #FlakyTests #JavaScript #WebTesting #TestAutomation #Coding
#Playwright #Testing #Automation #SoftwareTesting #Debugging #QA #FlakyTests #JavaScript #WebTesting #TestAutomation #Coding
Tomorrow I'm running a webinar on flaky tests. Then I'm going to run it again, just to make sure. :)
AI is the newest flaky suspect. Seven suspects. Live examples. A tool I built.
Bring your cornflakes.
us02web.zoom.us/webinar/regi...
#APITesting #SoftwareTesting #FlakyTests #TestAutomation
AI is the newest flaky suspect. Seven suspects. Live examples. A tool I built.
Bring your cornflakes.
us02web.zoom.us/webinar/regi...
#APITesting #SoftwareTesting #FlakyTests #TestAutomation
June 2, 2026 at 1:46 PM
Tomorrow I'm running a webinar on flaky tests. Then I'm going to run it again, just to make sure. :)
AI is the newest flaky suspect. Seven suspects. Live examples. A tool I built.
Bring your cornflakes.
us02web.zoom.us/webinar/regi...
#APITesting #SoftwareTesting #FlakyTests #TestAutomation
AI is the newest flaky suspect. Seven suspects. Live examples. A tool I built.
Bring your cornflakes.
us02web.zoom.us/webinar/regi...
#APITesting #SoftwareTesting #FlakyTests #TestAutomation
"Fragile" - the test was doomed the minute it was created.
"Flaky" - someone didn't do enough.
One word decides if we fix it, or accept fate.
testingil.com/2024/02/frag...
us02web.zoom.us/webinar/regi...
#APITesting #FlakyTests #SoftwareTesting
"Flaky" - someone didn't do enough.
One word decides if we fix it, or accept fate.
testingil.com/2024/02/frag...
us02web.zoom.us/webinar/regi...
#APITesting #FlakyTests #SoftwareTesting
May 19, 2026 at 1:49 PM
"Fragile" - the test was doomed the minute it was created.
"Flaky" - someone didn't do enough.
One word decides if we fix it, or accept fate.
testingil.com/2024/02/frag...
us02web.zoom.us/webinar/regi...
#APITesting #FlakyTests #SoftwareTesting
"Flaky" - someone didn't do enough.
One word decides if we fix it, or accept fate.
testingil.com/2024/02/frag...
us02web.zoom.us/webinar/regi...
#APITesting #FlakyTests #SoftwareTesting
Tomorrow Prof. Jeremy Bradbury & MSc student Riddhi More will be presenting "FlakyXbert: A Few-Shot Learning Framework for Detecting and Classifying Flaky Tests" at the AI Meets Software Quality International Colloquium (bit.ly/42DAZ4M)
#AI #LLM #testing #flakytests #dataaugmentation #bias
#AI #LLM #testing #flakytests #dataaugmentation #bias
February 2, 2025 at 8:34 PM
Tomorrow Prof. Jeremy Bradbury & MSc student Riddhi More will be presenting "FlakyXbert: A Few-Shot Learning Framework for Detecting and Classifying Flaky Tests" at the AI Meets Software Quality International Colloquium (bit.ly/42DAZ4M)
#AI #LLM #testing #flakytests #dataaugmentation #bias
#AI #LLM #testing #flakytests #dataaugmentation #bias
Florian Heubeck et al. thanks for having me at CloudLand 2025 yesterday - it's been a pleasure to be there, even with the advanced temperatures 🥵 . However for those occasions I can highly recommend the water roller coaster 💦
#cloudland2025 #heidepark #soltau #flakytests #talk
#cloudland2025 #heidepark #soltau #flakytests #talk
July 3, 2025 at 1:52 PM
Florian Heubeck et al. thanks for having me at CloudLand 2025 yesterday - it's been a pleasure to be there, even with the advanced temperatures 🥵 . However for those occasions I can highly recommend the water roller coaster 💦
#cloudland2025 #heidepark #soltau #flakytests #talk
#cloudland2025 #heidepark #soltau #flakytests #talk
AI writes tests fast. Great.
But those tests carry assumptions from everyone else's code it was trained on. Not yours. Theirs.
You just inherited a whole world's worth of assumptions. Have you noticed?
Full post on LI
www.linkedin.com/posts/gilzil...
#AITesting #SoftwareTesting #FlakyTests
But those tests carry assumptions from everyone else's code it was trained on. Not yours. Theirs.
You just inherited a whole world's worth of assumptions. Have you noticed?
Full post on LI
www.linkedin.com/posts/gilzil...
#AITesting #SoftwareTesting #FlakyTests
June 10, 2026 at 12:41 PM
AI writes tests fast. Great.
But those tests carry assumptions from everyone else's code it was trained on. Not yours. Theirs.
You just inherited a whole world's worth of assumptions. Have you noticed?
Full post on LI
www.linkedin.com/posts/gilzil...
#AITesting #SoftwareTesting #FlakyTests
But those tests carry assumptions from everyone else's code it was trained on. Not yours. Theirs.
You just inherited a whole world's worth of assumptions. Have you noticed?
Full post on LI
www.linkedin.com/posts/gilzil...
#AITesting #SoftwareTesting #FlakyTests
What makes a flaky test flaky?
The surprise. You expect order. Instead you get inconsistency.
We expect order, because - who would interfere with it?
Then something does.
And we spend the afternoon in the logs.
#APITesting #SoftwareTesting #FlakyTests
The surprise. You expect order. Instead you get inconsistency.
We expect order, because - who would interfere with it?
Then something does.
And we spend the afternoon in the logs.
#APITesting #SoftwareTesting #FlakyTests
May 25, 2026 at 1:06 PM
What makes a flaky test flaky?
The surprise. You expect order. Instead you get inconsistency.
We expect order, because - who would interfere with it?
Then something does.
And we spend the afternoon in the logs.
#APITesting #SoftwareTesting #FlakyTests
The surprise. You expect order. Instead you get inconsistency.
We expect order, because - who would interfere with it?
Then something does.
And we spend the afternoon in the logs.
#APITesting #SoftwareTesting #FlakyTests
🔫 🐞 Just in case you missed my talk about zapping the flakes at DevConf.cz 🔫 🐞 - here's the recording: www.youtube.com/watch?v=2xLE...
#devconfcz #devconf2025 #talk #flakytests #flakes #recording
#devconfcz #devconf2025 #talk #flakytests #flakes #recording
DevConf.CZ | Brno, Czechia
DevConf are free and open, annual, open-source community conferences for community contibutors, sponsored by Red Hat.
DevConf.cz
July 3, 2025 at 1:46 PM
🔫 🐞 Just in case you missed my talk about zapping the flakes at DevConf.cz 🔫 🐞 - here's the recording: www.youtube.com/watch?v=2xLE...
#devconfcz #devconf2025 #talk #flakytests #flakes #recording
#devconfcz #devconf2025 #talk #flakytests #flakes #recording
No software is an island.
We control what's inside our borders. But tests call services that may not answer. Configs that aren't ready. Environments we don't own.
We assume control. Until we don't have it.
Wednesday I'm running a webinar on where that breaks.
#APITesting #SoftwareTesting #FlakyTests
We control what's inside our borders. But tests call services that may not answer. Configs that aren't ready. Environments we don't own.
We assume control. Until we don't have it.
Wednesday I'm running a webinar on where that breaks.
#APITesting #SoftwareTesting #FlakyTests
June 1, 2026 at 12:15 PM
No software is an island.
We control what's inside our borders. But tests call services that may not answer. Configs that aren't ready. Environments we don't own.
We assume control. Until we don't have it.
Wednesday I'm running a webinar on where that breaks.
#APITesting #SoftwareTesting #FlakyTests
We control what's inside our borders. But tests call services that may not answer. Configs that aren't ready. Environments we don't own.
We assume control. Until we don't have it.
Wednesday I'm running a webinar on where that breaks.
#APITesting #SoftwareTesting #FlakyTests
How Much Do Flaky Tests Actually Cost?
https://www.kleore.com/blog/flaky-test-cost
#flakytests #ci #devops
https://www.kleore.com/blog/flaky-test-cost
#flakytests #ci #devops
May 12, 2026 at 9:39 PM
How Much Do Flaky Tests Actually Cost?
https://www.kleore.com/blog/flaky-test-cost
#flakytests #ci #devops
https://www.kleore.com/blog/flaky-test-cost
#flakytests #ci #devops
How to Fix Flaky Tests in GitHub Actions
https://www.kleore.com/blog/fix-flaky-tests-github-actions
#flakytests #ci #devops
https://www.kleore.com/blog/fix-flaky-tests-github-actions
#flakytests #ci #devops
May 20, 2026 at 5:01 PM
How to Fix Flaky Tests in GitHub Actions
https://www.kleore.com/blog/fix-flaky-tests-github-actions
#flakytests #ci #devops
https://www.kleore.com/blog/fix-flaky-tests-github-actions
#flakytests #ci #devops
Why Claude Code AutoFix Can’t Fix Flaky Tests
https://www.kleore.com/blog/claude-code-autofix-flaky-tests
#flakytests #ci #devops
https://www.kleore.com/blog/claude-code-autofix-flaky-tests
#flakytests #ci #devops
May 14, 2026 at 5:53 PM
Why Claude Code AutoFix Can’t Fix Flaky Tests
https://www.kleore.com/blog/claude-code-autofix-flaky-tests
#flakytests #ci #devops
https://www.kleore.com/blog/claude-code-autofix-flaky-tests
#flakytests #ci #devops
Black box testing: "I don't care how it's built."
Just "how it works". But that's built on assumptions.
Right most of the time. Wrong a few times.
And there are your flaky tests.
Drop the pretense of neutral testing. Care how it's built.
#APITesting #SoftwareTesting #FlakyTests
Just "how it works". But that's built on assumptions.
Right most of the time. Wrong a few times.
And there are your flaky tests.
Drop the pretense of neutral testing. Care how it's built.
#APITesting #SoftwareTesting #FlakyTests
May 20, 2026 at 2:47 PM
Black box testing: "I don't care how it's built."
Just "how it works". But that's built on assumptions.
Right most of the time. Wrong a few times.
And there are your flaky tests.
Drop the pretense of neutral testing. Care how it's built.
#APITesting #SoftwareTesting #FlakyTests
Just "how it works". But that's built on assumptions.
Right most of the time. Wrong a few times.
And there are your flaky tests.
Drop the pretense of neutral testing. Care how it's built.
#APITesting #SoftwareTesting #FlakyTests
KeyConcept Friday: ❓ What is a Flaky Test? A test that sometimes passes & sometimes fails with no code change. They undermine trust in automation. #FlakyTests #TestAutomation 🎲
May 30, 2025 at 2:10 AM
KeyConcept Friday: ❓ What is a Flaky Test? A test that sometimes passes & sometimes fails with no code change. They undermine trust in automation. #FlakyTests #TestAutomation 🎲
excited to talk about the topic that is dearest to my heart again: how to zap flaky tests in our code base. this is so important for the @kubevirt project
www.devtalks.ro/agenda/11-da...
#devtalks.ro #romania #bucharest #ci #flakytests #softwareengineering #zap #kubevirt
www.devtalks.ro/agenda/11-da...
#devtalks.ro #romania #bucharest #ci #flakytests #softwareengineering #zap #kubevirt
Day 1
Great community leaders will share the latest trends about future technologies on our stages. Join us!
www.devtalks.ro
June 4, 2025 at 7:10 AM
excited to talk about the topic that is dearest to my heart again: how to zap flaky tests in our code base. this is so important for the @kubevirt project
www.devtalks.ro/agenda/11-da...
#devtalks.ro #romania #bucharest #ci #flakytests #softwareengineering #zap #kubevirt
www.devtalks.ro/agenda/11-da...
#devtalks.ro #romania #bucharest #ci #flakytests #softwareengineering #zap #kubevirt
Fails In CI — The laptop is green. The pipeline is red. A clean Runtime tee for every test that waits until CI to develop principles.
#Runtime #Devops #DeveloperHumor #FlakyTests #ShirtsFrenzy #SoftwareTesting
#Runtime #Devops #DeveloperHumor #FlakyTests #ShirtsFrenzy #SoftwareTesting
August 28, 2026 at 9:27 PM
Fails In CI — The laptop is green. The pipeline is red. A clean Runtime tee for every test that waits until CI to develop principles.
#Runtime #Devops #DeveloperHumor #FlakyTests #ShirtsFrenzy #SoftwareTesting
#Runtime #Devops #DeveloperHumor #FlakyTests #ShirtsFrenzy #SoftwareTesting
Do you remember my talk at FOSDEM about flaky tests last year? 🤔 I’ll talk about an approach to zap flaky tests with AI. Pew-pew… 🔫
Come visit the Testing and Continuous Delivery DevRoom in UD6.215 on Saturday at 13:15!
tinyurl.com/4hb6hdep
#Flakes #FlakyTests #SoftwareTesting #CI #FOSDEM2025
Come visit the Testing and Continuous Delivery DevRoom in UD6.215 on Saturday at 13:15!
tinyurl.com/4hb6hdep
#Flakes #FlakyTests #SoftwareTesting #CI #FOSDEM2025
FOSDEM 2025 - Zap the Flakes! Leveraging AI to Combat Flaky Tests with CANNIER
tinyurl.com
January 31, 2025 at 3:26 PM
Do you remember my talk at FOSDEM about flaky tests last year? 🤔 I’ll talk about an approach to zap flaky tests with AI. Pew-pew… 🔫
Come visit the Testing and Continuous Delivery DevRoom in UD6.215 on Saturday at 13:15!
tinyurl.com/4hb6hdep
#Flakes #FlakyTests #SoftwareTesting #CI #FOSDEM2025
Come visit the Testing and Continuous Delivery DevRoom in UD6.215 on Saturday at 13:15!
tinyurl.com/4hb6hdep
#Flakes #FlakyTests #SoftwareTesting #CI #FOSDEM2025
After a long train trip I've finally arrived in Brno yesterday. 🥳
Ping me if you want to meet up!
And I'll talk about zapping flakes once again - pew pew 🔫 - session is Saturday 12:30
pretalx.devconf.info/devconf-cz-2...
#DevConf_CZ #brno #conference #flakytests
Ping me if you want to meet up!
And I'll talk about zapping flakes once again - pew pew 🔫 - session is Saturday 12:30
pretalx.devconf.info/devconf-cz-2...
#DevConf_CZ #brno #conference #flakytests
DevConf.CZ | Brno, Czechia
DevConf are free and open, annual, open-source community conferences for community contibutors, sponsored by Red Hat.
devconf.cz
June 12, 2025 at 6:23 AM
After a long train trip I've finally arrived in Brno yesterday. 🥳
Ping me if you want to meet up!
And I'll talk about zapping flakes once again - pew pew 🔫 - session is Saturday 12:30
pretalx.devconf.info/devconf-cz-2...
#DevConf_CZ #brno #conference #flakytests
Ping me if you want to meet up!
And I'll talk about zapping flakes once again - pew pew 🔫 - session is Saturday 12:30
pretalx.devconf.info/devconf-cz-2...
#DevConf_CZ #brno #conference #flakytests
How to 𝗵𝗮𝗻𝗱𝗹𝗲 𝗳𝗹𝗮𝗸𝘆 𝘁𝗲𝘀𝘁𝘀 is the first video of 2025 on my YouTube channel. It's a question I got asked from the community. Thanks Eric for raising this question!
See my answer in the video:
📺 youtu.be/iPzRnrLSZa0
#SoftwareTesting #Testing #FlakyTests #TestAutomation
See my answer in the video:
📺 youtu.be/iPzRnrLSZa0
#SoftwareTesting #Testing #FlakyTests #TestAutomation
How to Handle Flaky Tests - Software Testing Community Question No. 4
YouTube video by Software Testing by Daniel Knott
youtu.be
January 6, 2025 at 6:45 AM
How to 𝗵𝗮𝗻𝗱𝗹𝗲 𝗳𝗹𝗮𝗸𝘆 𝘁𝗲𝘀𝘁𝘀 is the first video of 2025 on my YouTube channel. It's a question I got asked from the community. Thanks Eric for raising this question!
See my answer in the video:
📺 youtu.be/iPzRnrLSZa0
#SoftwareTesting #Testing #FlakyTests #TestAutomation
See my answer in the video:
📺 youtu.be/iPzRnrLSZa0
#SoftwareTesting #Testing #FlakyTests #TestAutomation
It's midnight.
You're tests are running.
Do you trust them?
Or want to run them again, just in case?
It's the midnight flakiness curse.
#APITesting #SoftwareTesting #FlakyTests #TestAutomation #QualityEngineering
You're tests are running.
Do you trust them?
Or want to run them again, just in case?
It's the midnight flakiness curse.
#APITesting #SoftwareTesting #FlakyTests #TestAutomation #QualityEngineering
May 27, 2026 at 1:35 PM
It's midnight.
You're tests are running.
Do you trust them?
Or want to run them again, just in case?
It's the midnight flakiness curse.
#APITesting #SoftwareTesting #FlakyTests #TestAutomation #QualityEngineering
You're tests are running.
Do you trust them?
Or want to run them again, just in case?
It's the midnight flakiness curse.
#APITesting #SoftwareTesting #FlakyTests #TestAutomation #QualityEngineering
Fighting Flakiness webinar goes live today. Seven suspects and a tool I built.
If you LIKE debugging flaky tests for hours - skip this one.
Last chance.
us02web.zoom.us/webinar/regi...
#APITesting #SoftwareTesting #FlakyTests #TestAutomation #QualityEngineering
If you LIKE debugging flaky tests for hours - skip this one.
Last chance.
us02web.zoom.us/webinar/regi...
#APITesting #SoftwareTesting #FlakyTests #TestAutomation #QualityEngineering
June 3, 2026 at 9:06 AM
Fighting Flakiness webinar goes live today. Seven suspects and a tool I built.
If you LIKE debugging flaky tests for hours - skip this one.
Last chance.
us02web.zoom.us/webinar/regi...
#APITesting #SoftwareTesting #FlakyTests #TestAutomation #QualityEngineering
If you LIKE debugging flaky tests for hours - skip this one.
Last chance.
us02web.zoom.us/webinar/regi...
#APITesting #SoftwareTesting #FlakyTests #TestAutomation #QualityEngineering
🛠 Our new guide covers what actually causes flakiness, how to measure flake rate, when to quarantine a test, and why retries hide bugs instead of fixing them.
🔗 Read it here → https://qasphere.com/blog/flaky-tests/
#FlakyTests #TestAutomation #SoftwareTesting #CICD
🔗 Read it here → https://qasphere.com/blog/flaky-tests/
#FlakyTests #TestAutomation #SoftwareTesting #CICD
August 18, 2026 at 2:36 PM
🛠 Our new guide covers what actually causes flakiness, how to measure flake rate, when to quarantine a test, and why retries hide bugs instead of fixing them.
🔗 Read it here → https://qasphere.com/blog/flaky-tests/
#FlakyTests #TestAutomation #SoftwareTesting #CICD
🔗 Read it here → https://qasphere.com/blog/flaky-tests/
#FlakyTests #TestAutomation #SoftwareTesting #CICD
Flaky tests causing headaches? 🤯
Discover João Proença's insights on identifying and managing flaky tests in the MoT Software Testing Glossary.
Enhance your expertise and boost your MoT profile by contributing your own definitions!
#MoTGlossary #FlakyTests
Discover João Proença's insights on identifying and managing flaky tests in the MoT Software Testing Glossary.
Enhance your expertise and boost your MoT profile by contributing your own definitions!
#MoTGlossary #FlakyTests
January 20, 2025 at 11:02 AM
Flaky tests causing headaches? 🤯
Discover João Proença's insights on identifying and managing flaky tests in the MoT Software Testing Glossary.
Enhance your expertise and boost your MoT profile by contributing your own definitions!
#MoTGlossary #FlakyTests
Discover João Proença's insights on identifying and managing flaky tests in the MoT Software Testing Glossary.
Enhance your expertise and boost your MoT profile by contributing your own definitions!
#MoTGlossary #FlakyTests