Experience (XP) Series Webinars Home / Video /

Flaky Tests from an Engineering Perspective

Flaky Tests from an Engineering Perspective

...Playlist

...

About The Video

Catch the latest episode of the XP Series webinar featuring 𝐁𝐨ő𝐭𝐣𝐚𝐧 π‚π’π πšπ§, Developer Relations at Semaphore. Join us for a deep dive into what the engineering perspective looks like for flaky tests.

In this episode, Bostjan explores why flaky tests are such a significant issue, highlighting their impact on wasting time through needless re-runs and disrupting the software delivery lifecycle. With test suites often run in CI/CD tools, flaky tests lead to ineffective feedback loops and inefficient workflows, alongside the substantial costs of machine time.

Key Topics Covered

Introduction to Flaky Tests: A comprehensive overview of flaky tests, highlighting their impact on software delivery, the necessity of efficient feedback loops, and the costs associated with machine time and inefficient workflows.

Root Causes of Flaky Tests: Exploration of the primary causes of flaky tests, including dependencies, environment inconsistencies, and the human factor. The session discusses the significance of understanding these root causes for effective mitigation.

Detection Techniques: Discussion on various techniques to detect flaky tests, ranging from simple rerun strategies to sophisticated machine learning approaches that analyze historical test data for patterns indicative of flakiness.

Mitigation and Management Strategies: Insightful strategies to manage and mitigate flaky tests, emphasizing the importance of mocks and stubs, test isolation, dependency scanning, and the prioritization of critical tests based on their impact on business logic.

Stability and Infrastructure: An examination of how environmental stability and infrastructure reliability play crucial roles in reducing the occurrence of flaky tests, ensuring consistency across development, staging, and testing environments.

The Impact of Flaky Tests: An in-depth look at how flaky tests can disrupt the software delivery lifecycle, leading to ineffective feedback loops, increased costs, and frustration among engineering teams.

Identifying Flaky Tests: Practical advice on identifying flaky tests using tools and dashboards that provide insights into test suite performance, disruptions caused by flaky tests, and their impact on CI/CD pipelines.

Collaborative Reviews: The value of collaborative code reviews involving both developers and QA engineers to bring diverse perspectives to the forefront, enhancing the overall quality of the code and tests.

Closing Thoughts: Concluding remarks on the importance of awareness and proactive management of flaky tests to maintain high software quality and efficient delivery processes.

Related Blogs & Hubs

Testing Tomorrow: Unravelling the AI in QA Beyond Automation

Shifting Accessibility Testing Left with LambdaTest and Evinced

How Can We Speed Up Our Work during Web Application Test Automation?

Automated Test Execution Reporting

More Videos from Experience (XP) Series Webinars

LT Video

Building a Test Automation Framework for TV Apps & Scaling at FX Digital | Episode 38

Experience (XP) Series Webinars
LT Video

Leading the Charge in Software Quality with Zero Bug Revolution | Episode 37

Experience (XP) Series Webinars
LT Video

AI-Readiness: Are You Building the Future or Falling Behind | Episode 36

Experience (XP) Series Webinars
LT Video

Upskilling Quality Engineers: A Success Story in SDET Transformation | Episode 35

Experience (XP) Series Webinars
LT Video

Creating Reliable and Scalable Test Automation Frameworks | Episode 34

Experience (XP) Series Webinars
LT Video

GenAI for Quality Transformation | Episode 33

Experience (XP) Series Webinars
LT Video

Supercharge Your Data Quality Testing with AI/ML | Episode 32

Experience (XP) Series Webinars
LT Video

In-Depth with Playwright: A Modern Testing Framework | Episode 31

Experience (XP) Series Webinars
LT Video

Building Quality Software: AI-based testing approach with Jira and QMetry | Episode 30

Experience (XP) Series Webinars
LT Video

Rethinking the Role of QA Profile | Episode 29

Experience (XP) Series Webinars
LT Video

The Power of Generative AI in Reducing Maintenance and Enhancing Speed | Episode 28

Experience (XP) Series Webinars
LT Video

Optimize Issue Tracking: Integrating SpiraTeam with LambdaTest | Episode 27

Experience (XP) Series Webinars
LT Video

Innovation Accelerated: The Intersection of AI and Quality Engineering | Episode 26

Experience (XP) Series Webinars
LT Video

Impact and Potentials of GenAI to the IT Engineers | Episode 25

Experience (XP) Series Webinars
LT Video

The Myth of β€˜Best Practice’ | Episode 24

Experience (XP) Series Webinars
LT Video

From Brainwave to Inbox: Avo's Whimsical Adventure through AI-Powered Test Automation | Episode 23

Experience (XP) Series Webinars
LT Video

Mastering User-Centric Mindset Unlocking Your Potential as a Tester | Episode 22

Experience (XP) Series Webinars
LT Video

Future Trends and Innovations in Gen AI for Quality Engineering | Episode 21

Experience (XP) Series Webinars
LT Video

Flaky Tests from an Engineering Perspective | Episode 20

Experience (XP) Series Webinars
LT Video

Testing Tomorrow: Unravelling the AI in QA Beyond Automation | Episode 19

Experience (XP) Series Webinars
LT Video

Shifting Accessibility Testing Left with LambdaTest and Evinced | Episode 18

Experience (XP) Series Webinars
LT Video

Building Products that Drive Better Results with Shortcut | Episode 17

Experience (XP) Series Webinars
LT Video

How To Speed Up Our Work During Web Automation | Episode 16

Experience (XP) Series Webinars
LT Video

Automated Test Execution Reporting | Episode 15

Experience (XP) Series Webinars
LT Video

Using AI for Effective Test Generation | Episode 14

Experience (XP) Series Webinars
LT Video

Navigating the Future of Quality Engineering in 2024 | Episode 13

Experience (XP) Series Webinars
LT Video

Faster Feedback with Intelligent CD Pipelines | Episode 12

Experience (XP) Series Webinars
LT Video

Fast and Furious: The Psychology of Web Performance | Episode 11

Experience (XP) Series Webinars
LT Video

How Codemagic Mitigates Challenging Mobile App Testing Environments | Episode 10

Experience (XP) Series Webinars
LT Video

Revolutionizing Testing with Test Automation as a Service (TaaS) | Episode 9

Experience (XP) Series Webinars
LT Video

Crawl, Walk, Run...Fly - Take your build and test pipeline to the next level | Episode 8

Experience (XP) Series Webinars
LT Video

Fast-Tracking Project Delivery:Tips from a Recovering Perfectionist | Episode 7

Experience (XP) Series Webinars
LT Video

End-to-End Test Automation with Provar | Episode 6

Experience (XP) Series Webinars
LT Video

Shift-Left: Accelerating Quality Assurance in Agile Environments | Episode 5

Experience (XP) Series Webinars
LT Video

Man Vs Machine: Finding (replicable) bugs post-release | Episode 4

Experience (XP) Series Webinars
LT Video

Testing AWS applications locally and on CI with LocalStack | Episode 3

Experience (XP) Series Webinars
LT Video

Democratise Automation to Build Autonomy and Go-To-Market Faster | Episode 2

Experience (XP) Series Webinars
LT Video

Client Feedback & Quality Assurance in Web Design for Agencies | Episode 1

Experience (XP) Series Webinars