I’ve written before about the links I see between joking and testing – about the setting up of assumptions, the reframing, and the violated expectations, amongst other things. I like to listen to the The Comedian’s Comedian podcast because it encourage…
Earlier today, Dorothy Graham presented a webinar on her thoughts about test coverage. For me, listening to this webinar was a trip down memory lane – I immediately thought of the ISTQB Foundation exam I sat in 2012 and the multi-choice questions I had to prepare for when it came to the different types of coverage (But I really enjoyed hearing Dorothy’s analogies on coverage (I find analogies are a great way to explain things). This post is not a summary of webinar, but just some of my highlights.
The travel analogy
Dorothy started off with an analogy using Scratchie maps – those ones where you (typically) scratch off the countries you have visited. She questioned “But what do I scratch off? cities? states? countries?” Initially she scratched off 74 cities in the map, but we couldn’t really see them.
She then proceeded to scratch off states then countries. But she commented that it wasn’t really representative of how much of these places she’s actually experienced – it was “rather shallow coverage”. (For example: scratching off all of Brazil when you have only been to Rio de Janeiro)
What is coverage?
“An Objective measurement of some aspect of thoroughness”
In my opinion, people should really pay attention to the “some aspect” part – that is, the person reporting the coverage has specifically chosen this type of coverage. It’s always good to check how they have defined coverage and why they chose to measure the test coverage in that specific way.
She then later explored different ways of measuring coverage: menu options, errors, lines of code etc. And then explained when you see “85% coverage or 100% coverage” that it’s one type of coverage. (Feel free to watch the webinar online if you’d like to learn more about the different types of coverage)
The butter and strawberry jam analogy
Butter (to explain width of coverage)
When you spread butter on toast it tends to go on evenly and all over the slice of bread.
Strawberry Jam (to explain depth of coverage)
When you spread strawberry jam on jam, it doesn’t go on the toast evenly, some parts of the bread are more “well covered” than others.
My biggest takeaways:
My biggest takeaways from this webinars were the travel analogy and the butter and strawberry jam analogy. To be honest, I feel like I already have a solid understanding of the different types of coverage, but getting some interesting new ideas on how to explain coverage to clients was definitely beneficial.
Have you ever wanted to learn a little bit about Selenium WebDriver but didn’t know where to start? Turns out there are some good tips / tutorials online for practicing writing Selenium in Ruby. One of those is a newsletter called Elemental Selenium that has something like 70 tips. You can sign up for the […]
TL;DR In this post I will explain how to set up docker when you are behind corporate proxy. All Internet tutorials about any technology take assumption that you are not behind a proxy. Working for my client that must use corporate proxy, I spent a lot of working hours discovering how to use docker behind a … Continue reading Docker behind a proxy →
This month’s Lean Coffee was hosted by Redgate. Here’s some brief, aggregated comments and questions on topics covered by the group I was in.Why ‘test’ rather than ‘prove’?The questioner had been asked by a developer why he wasn’t …