TestMu
Testμ 2024
/
Mesut Durukal

Mesut Durukal

Senior QA Automation Engineer, Indeed

Watch Now

(Recordings Available)

session

Dancing with the Metrics: Monitoring for keeping on track

About the Talk

Elevator Pitch

We try to ensure the quality and our confidence in our deliverables. But how can measure the quality to make sure our goals are achieved? Let's figure out what are the key quality metrics and how we can measure them.

Motivation

Nowadays, great rivalry exists in the software world. Everyone tries to reduce time to market and cost with a broad context of features. To improve the competence of our product, we try to add several compatibility and scalability specifications. But sometimes less is more. To deploy in 1 week with several issues, or deploy in 2 weeks with no major issues?

We're talking about the elements that sustain an output here: Time, Coverage, Cost, and Quality. A bit different from others, measuring quality is challenging.

Correlated to quality, the performance of Quality teams is also under the spotlight:

  • What are they really doing? What is the outcome of QA activities?
  • Are they successful? What do the QA activities change?

Problems:

How can we measure the quality and the outcome of the QA teams/activities?

Solutions:

Firstly, we will talk about being ready for measurement. Unless we do not have proper tools or state transition definitions, we won't be able to analyze data. Then the big question is what to measure. We can list hundreds of metrics, but which set of them is the best to get some insights? Once we know what to collect, the way to minimize manual effort is automation. After getting raw data, we are good to create fancy monitoring tools. Graphs and dashboards are great ways to provide visual pieces of evidence.

Eventually, last but definitely not least is the interpretation of the results. Numbers are great, but what can we understand from them? Are there any action items we need?

Wrapping up, a lifecycle of a monitoring activity looks like this:

  • Customizing environments to enhance transparency/visibility
  • Choose metrics: Proposed decision criteria
  • Automate measurement
  • Creating visuals
  • Analysis

Key Takeaways:

  • We will try to find answers to the questions:
  • Which metrics can we track?
  • How can we deal with dozens of metrics?
  • How can we automate metrics collection?
  • After getting data, what is next?

About the Speaker

Mesut has 15+ years of experience in Industrial Automation, IoT platforms, SaaS/PaaS and Cloud Services, the Defense Industry, Autonomous Mobile Robots, and Embedded and Software applications. Along with having proficiency in CMMI and Scrum & PMP experiences under his belt, he has taken various roles as (Quality Owner, Hiring Manager, and Chapter Lead) in multinational projects.

He has expertise in test automation and integration to CI/CD platforms supporting continuous testing. Besides, he has been facilitating test processes and building the test strategy and lifecycle of the projects. He is a frequent international speaker, the best presentation award winner, and a various program committees member.

About Testµ Conference

Testµ Conference is a virtual or online-only conference to define the future of testing. Join over 30,000+ software testers, developers, quality assurance experts, industry experts, and thought leaders for 3 days of learning, testing, and networking at Testμ Conference 2024 by LambdaTest.

TestMu

Join the Testing Event of the Year

By clicking Register Now you accept the LambdaTest Terms of Service, Code of Conduct and acknowledge the Privacy Policy and Cookie Policy

(Recordings Available)

Testmu