Peer Conferences and Learning

In the past two years, “Peer conference” and “exhibition conference” are terms I’ve come to use a lot. A peer conference is a get together among practitioners of a particular discipline for the purpose of learning to practice better. It’s a round table, sometimes literally. An exhibition conference is what most people call just conference. There is often not much conferring going on at an exhibition conference. The point of most such “conferences” is for one class of people to put on a show for another class of people.

At an exhibition conference, it is considered impolite for someone to stand up and criticize the ideas of a speaker. It would be as if someone tried to talk back to the screen at a movie theatre. For many people attending exhibition conferences, there is a presumption that the speakers are experts. Thou Shalt Not Doubt Experts.

At a peer conference, everyone is a speaker, and it is expected that we will criticize each others’ ideas. We’re after deep learning, and it’s hard to get that without getting behind the Powerpoint glitz.

In my community, we’ve held sixty or seventy of these meetings since the first one in 1997 (the Los Altos Workshop on Software Testing, organized by Cem Kaner and Brian Lawrence). It’s become a vital mechanism for building relationships and developing our craft. It’s getting a little crazy, actually. In the last three weeks I’ve been to three peer conferences: The Workshop on Combinatorial Testing (WOCT), The Exploratory Testing Research Summit (ExTRS), and the Workshop on Training Software Testers (WTST).

Peer conferences create an environment for cross-organizational learning.

Recently, I’ve noticed a shift in the culture of the meetings. I’ve started using them as opportunities to challenge my colleagues to “testing duels” of various forms. Some of my colleagues have followed suit, so that when we meet, I can expect to be barraged by brainteasers or exhortations to test this or that with one or more hands tied behind n-squared backs. As a result, I get terribly sleep-deprived. It’s wonderful.

This is important if we want to build a better craft. For instance, I don’t think that the Agile community understands testing, yet. Testing is a skill of the mind, not a software tool that glows red or green with news of the trivial. I think the community of genuine software testers (those who devote themselves to the study and practice of dispelling illusions about software products) has a better hope of helping the Agile programmers understand what we do if we pose testing problems to each other. We should show those guys that not just anyone who falls off the backend of a compiler can expect to test with the big dogs.

I dream of a testing craft where bright young testers study hard to distinguish themselves at the next local testing tournament, the state championship, or the nationals.

1 thought on “Peer Conferences and Learning

  1. I got into a minor firefight on (or some other such place, I already forget which) for saying something an awful lot like

    >An exhibition conference is what most people call just conference. There is often not much >conferring going on at an exhibition conference. The point of most such “conferences� is for >one class of people to put on a show for another class of people.

    I sort of wish I’d known, at the time, that you’d already said this. It would have been easier for me to just reference you than to figure out how to say the same thing (in my own more passionate and therefore more easily dismissed) terminology.

    Do you know of any peer-type software testing conferences out here in the greater Boston area? I haven’t been to a software conference of any kind since 1992 — the experience disgusted me that much — and I think maybe it’s time to get off the high horse and talk shop with like-minded folks again.


    [James’ Reply: Peer conferences are generally very small (<50 people) and are put on by particular communities on their own behalf. When the context-driven folks put one on, it's generally announced on I don’t know of any coming up in the Boston area, but the call for presentations just went out for the next STIFS conference, which is in New York City. It’s dedicated to testing financial systems.

    The CAST conference is kind of a hybrid. It is the annual conference of the Association for Software Testing. It is organized by people who are peer conference veterans, and they’ve created a process that is more interactive and flexible than you’ll find at STAR. The next CAST will be held in June, in Seattle. My brother, Jonathan, is taking the lead on making that happen.

    I would recommend that you organize a 15-person peer conference for yourself. I can tell you how to set it up. I may even be able to attend if you do it at the right time.] 

Leave a Reply

Your email address will not be published. Required fields are marked *


This site uses Akismet to reduce spam. Learn how your comment data is processed.