Badges for singers

We had a badges session last week at the CETIS conference (here are some summary slides and my slides on some requirements). I’d like to reflect on that, not directly (as Phil has done) but instead by looking forward on how a badge system for leisure activity might be put together.

In the discussion part of our conference session, we looked at two areas of potential application of badges. First, for formative assesssment in high-stakes fields (such as medicine); second, for communities of practice such as the ones CETIS facilitates, still in the general area of work. What we didn’t look at was badges for leisure or recreation. The Mozilla Open Badges working paper makes no distinction between badges for skills that are explicitly about work and for skills that are not obviously about work, so looking at leisure applications complements the conference discussion nicely, while providing an example to think through many of the main issues with badges.

The worked example that follows builds on my personal knowledge of one hobby area, but is meant to be illustrative of many. Please think of your own favourite leisure activities.

Motivation

On returning from the conference, on the very same day as the badges session, it happened to be a rehearsal evening for the small choir I currently sing with. So what more natural for me to think about than a badge system for singing. The sense of need for such a system has continued to grow on me. Many people can sing well enough to participate in a choir. While learners of classical instruments have “grade” examinations and certificates indicating the stages of mastery of an instrument, there is no commonly used equivalent for choral singing. Singing is quite a diverse activity, with many genres as well as many levels of ability. The process of established groups and singers getting together tends to be slow and subject to chance, but worse, forming a new group is quite difficult, unless there is some existing larger body (school, college, etc) all the singers belong to.

Badges for singers might possibly help in two different ways. First, badges can mark attainment. A system of attainment badges could help singers find groups and other singers of the right standard for them to enjoy singing with. It may be worthy, but not terribly exciting singing with a group at a lower level, and one can feel out of one’s depth or embarrassed singing with people a lot more accomplished. So, when a group looks for a new member, it could specify levels of any particular skills that were expected, as well as the type of music sung. This wouldn’t necessarily remove the need for an audition, but it would help the right kind of singer to consider the choir. Compared with current approaches, including singers hearing a choir performing and then asking about vacancies, or learning of openings through friends, a badge system could well speed things up. But perhaps the greatest benefit would be to singers trying to start new groups or choirs, where there is no existing group to hear about or to go to listen. Here, a badge system could make all the difference between it being practical to get a new group together, or failing.

Second, the badges could provide a structured set of goals that would help motivate singers to broaden and improve their abilities. This idea of motivating steps in a pathway is a strong theme in the Open Badges documentation. There must be singers at several levels who would enjoy and gain satisfaction from moving on, up a level maybe. In conjunction with groups setting out their badge requirements, badges in the various aspects of choral singing would at very least provide a framework within which people could more clearly see what they needed to gain experience of and practice, in order to join the kind of group they really want.

By the way, I recognise that not all singing groups are called “choirs”. Barbershop groups tend to be “choruses”, while very small groups are more often called “ensembles”; but for simplicity here I use the term “choir” to refer to any singing group.

Teachers / coaches

Structured goals lead on to the next area. If there were a clear set of badged achievements to aim for, then the agenda for coaches, tutors, et al. would be more transparent. This might not produce a great increase in demand for paid tuition (and therefore “economic” activity) but might well be helpful for amateur coaching. Whichever way, a clear set of smaller, more limited goals on tried and tested pathways would provide a time-honoured approach to achieving greater goals, with whatever amount of help from others that is needed.

Badge content

I’ve never been in charge of a choir for more than a few songs, but I do have enough experience to have a reasonable guess at what choirmasters and other singers want from people who want to join them. First, there are the core singing skills, and these might be broken down for example like this:

  • vocal range and volume (most easily classified as soprano / alto / tenor / bass)
  • clarity and diction
  • voice quality and expressiveness (easy to hear in others, but hard to measure)
  • ability to sing printed music at first sight (“sight-singing”)
  • attentiveness to and blend with other singers
  • ability to sing a part by oneself
  • speed at learning one’s part if necessary
  • responsiveness to direction during rehearsal and performance
  • specialist skills

It wouldn’t be too difficult to design a set of badges that expressed something like these abilities, but this is not the time to do that job, as such a structure needs to reflect a reasonable consensus involving key stakeholders.

Then there are other personal attributes, not directly related to singing, that are desirable in choir members, e.g.:

  • reliability of attendance at rehearsals and particularly performances
  • helpfulness to other choir members
  • diligence in preparation

Badges for these could look a little childish, but as a badge system for singing would be entirely voluntary, perhaps there would be no harm in defining them, for the benefit of junior choirs at least.

Does this cover everything? It may or may not cover most of what can be improved — those things that can be better or not so good — but there is one other area that is vital for the mutual satisfaction of choir and singer. Singers have tastes in music; choirs have repertoires or styles they focus on. To get an effective matching system, style and taste would have to be represented.

Assessing and awarding badges

So who would assess and award these badges? The examinations for musical instrument playing are managed by bodies such as the ABRSM (indeed including solo singing). These exams have a very long history, and are often recognised, e.g. for entry to musical education institutions. But choral singers are usually wanting to enjoy themselves, not gain qualifications so they can be professional musicians. They are unlikely to want to pay for exams for what is just a hobby. That leaves three obvious options: choirmasters, fellow singers, and oneself.

In any case, the ABRSM and similar bodies already have their own certificates and records. A badge system for them would probably be just a new presentation of what currently exists. The really interesting challenge is to consider how badges can work effectively without an official regulating body.

On deeper consideration, there really isn’t much to choose between choirmasters and fellow singers as the people who award choral singing badges. There is nothing to stop any singer being a choirmaster, anyway. There is not much incentive for people to misrepresent their choral singing skills: as noted before, it’s not much fun being in a choir of the wrong standard, nor in singing music one doesn’t like much. So, effectively, a badge system would have the job of making personal and choir standards clear.

There is an analogy here with language skills, which are closely related in any case. The Europass Language Passport is designed to be self-assessed, with people judging their own ability against a set of criteria that were originally defined by the Council of Europe. The levels — A1 to C2 — all have reasonably clear descriptors, and one sees people describing their language skills using these level labels increasingly often.

This is all very well if people can do this self-assessment accurately. The difficulty is that some of the vital aspects of choral singing are quite hard to assess by oneself. Listening critically to one’s own voice is not particularly easy when singing in a group. It might be easier if recording were more common, but again, most people are unfamiliar with the sound of their own voice, and may be uncomfortable listening to it.

On the other hand, we don’t want people, in an attempt to be “kind”, to award each other badges over-generously. We could hope that dividing up the skills into enough separate badges would mean that there would be some badges for everyone, and no one need be embarrassed by being “below average” in some ways. Everyone in a choir can have a choir membership badge, which says something about their acceptance and performance within the choir as a whole. Then perhaps all other choir members can vote anonymously about the levels which others have reached. Some algorithm could be agreed for when to award badges based on peer votes.

The next obvious thing would be to give badges to the choir as a whole. Choirs have reputations, and saying that one has sung in a particularly choir may mean something. This could be done in several ways, all involving some external input. Individual singers (and listeners) could compare the qualities of different choirs in similar genres. Choral competitions are another obvious source of expert judgement.

Setting up a badge system

The more detailed questions come to a head in the setting up of an actual badge system. The problem would not only be the ICT architecture (such as Mozilla Open Badges is a working prototype for) but also the organisational arrangements for creating the systems around badges for singers. Now, perhaps, we can see more clearly that the ICT side is relatively easy. This is something that we are very familiar with in CETIS. The technology is hardly ever the limiting factor — it is the human systems.

So here are some questions or issues (among possibly many more) that would need to be solved, not necessarily in this order.

  • Who would take on responsibility for this project as a whole? Setting up a badge system is naturally a project that needs to be managed.
  • Who hosts the information?
  • How is the decision made about what each badge will be, and how it is designed?
  • How would singers and choirs be motivated to sign up in the first place?
  • If a rule is set for how badges are to be awarded, how is this enforced, or at least checked?
  • Is Mozilla Open Badges sufficient technical infrastructure, and if not, who decides what is?
  • Could this system be set up on top of other existing systems? (Which, or what kind?)

Please comment with more issues that need to be solved. I’ll add them if they fit!

Business case

And how does such a system run, financially? The beneficiaries would primarily be choirs and singers, and perhaps indirectly people who enjoy listening to live choral music. Finding people or organisations in whose financial interests this would be seems difficult. So it would probably be useful for the system to run with minimal resources.

One option might be to offer this as a service to one or more membership organisations that collects fees from members, or alternatively, as an added service that has synergy with an existing paid-for service. However, the obvious approach of limiting the service to paid members would work against its viability in terms of numbers. In this case, the service would in effect be advertising promoting the organisation. Following the advertising theme, it might be seen as reasonable, for users who do not already pay membership, to receive adverts from sellers of music or organisers of musical events, which could provide an adequate income stream. The nice thing is that the kind of information that makes sense for individuals to enter, to improve the effectiveness of the system, could well be used to target adverts more effectively.

Would this be enough to make a business case? I hope so, as I would like to use this system!

Reflection

I hope that this example illustrates some of the many practical and possibly thorny issues that lie before a real working badge system can be implemented, and these issues are not primarily technical. What would be really useful would be to have a working technical infrastructure available so that at least some of the technical issues are dealt with in advance. As I wrote in comments on a previous post, I’m not convinced that Mozilla Open Badges does the job properly, but at least it is a signpost in the right direction.

Academic humility

Another conversation with Mark Johnson yesterday got me thinking seriously about what the role of humility and of confidence is in the academic community. If there is a literature on this, I don’t know it, so my remarks here are appropriately tentative. But the issue is of surprising importance to personal development, so perhaps worth the risk of some speculation.

Back when I was doing my PhD (gulp) years ago, I suppose I must have recognised, probably only just in time, the importance of this for a PhD candidate to turn into a fully-fledged member of the academic community. To cut a long story short, I would now say that it should be a requirement of any PhD viva for any candidate who is in line to pass to be thrown a few questions outside of their area of research. I fear I don’t recall which such questions were asked of me, but perhaps they could have been about more mainstream psychology, for example.

There seems to me to be a range of acceptable answers to questions outside one’s area of expertise. The simplest is something like “I’m sorry, I don’t know.” PhD candidates are not meant to be masters of general knowledge. While this answer would be problematic if the question is to do with the candidate’s central thesis, when off topic it is not only allowed, but just about necessary. Or it could be, “I haven’t read enough of the literature to know the answer there, so I’d rather not speculate.” Or, at a pinch, “Well, I don’t know this literature well, but I’d guess that …”. Certainly not just an unqualified unfounded opinion in a PhD viva.

This isn’t really the flavour of the month, though, is it? The world seems to be fuller than ever of people willing to tout their own conjectures, or worse, prejudices, as facts. People in all walks of life seem to be called upon to be confident in their own views, so it is hard to find good role models for appropriate academic or intellectual humility. There was Socrates, of course, but that was rather a long time ago for people with little sense of history.

Why should this matter? One thing pointed out by Mark was the interests of future students of this potential member of the academic community. To help students reach their own full intellectual maturity, it is rarely a good thing to lay down “the truth” and expect students to lap it up. Do this, perhaps, for younger school pupils, if they still need a basic set of working views to start with, and provided that the same line is taken by all other teachers in the establishment. But after that, teachers, lecturers, mentors, coaches, need to provide good and timely questions – another thing Socrates excelled at.

Perhaps undergraduates do need to absorb a corpus of existing established belief on a topic, but they also need a clear awareness of the boundaries of existing knowledge. Focusing on what one does know is less likely to help than focusing on what people dispute.

This takes me back so strongly to the work of William G Perry, Robert Kegan, and Darren Cambridge. There is a hard challenge here when one comes to the stage of PhD study – the academic apprenticeship. On the one hand, as Kegan points out, a graduate needs to come to their own conclusions, not just accept one single authority in a discipline. As Darren Cambridge points out, many subjects have “essentially contestable” concepts there to be studied, and portfolio practice allows the learners to argue for their position; to marshal evidence for it; to be a co-creator of meaning in their part of the academic world. This is the place, perhaps, for confidence, because if one is not confident of one’s own intellectual position, who else will take it seriously? Who will count it as a material contribution to the academic world? As I recall it, this corresponds at least roughly to Kegan’s “4th Order” thinking.

Kegan’s 5th (and final) Order is rather more elusive. I can’t summarise such a subtle concept here quickly – go read “In Over Our Heads” etc. But what Kegan calls the 5th Order to me is to do with being aware of all the orders; being able to adjust one’s response to fit the person with whom one is conversing. This is what teachers should be aiming at, it seems to me. They should be well-developed, intellectually and ethically, in themselves, but also aware of the needs of those who are not so well-developed, and able to speak to their condition. And this feels like a deeper and even more wholesome kind of humility than the humility of knowing the boundaries of one’s specialist area of study. It includes the position that all one’s specialist knowledge is useless and inappropriate in some contexts. It includes the idea that to question every tradition in a post-modernist way is not the right thing to do for people who have not yet even established their own way.

This can be confusing, which I suppose is why it requires unusual maturity. To those at earlier stages, one may need mainly to be a knowledgeable and reliable authority. To those at later stages, one needs first to leave room for advanced learners to develop their own ideas and positions, and then to model comfort with being uncertain, to prepare the way for the learner to be achieve the same true mastery.

I turn back to T.S. Eliot, East Coker:

“The only wisdom we can hope to acquire
Is the wisdom of humility: humility is endless.”

Questions about ACTA

The Anti-Counterfeiting Trade Agreement (ACTA) has gathered much press over recent days. The arguments raised are worrying, but also rather confused. From the point of view of intellectual property and openness (which concerns us in many ways in CETIS, JISC, and UK HE) it is worth aiming some very sharp questions at the weak intellectual foundations of ACTA.

It is worth reading the text of the agreement (just search for a chunk of what I reproduce here). We need go no further than the very first two paragraphs:

The Parties to this Agreement,

Noting that effective enforcement of intellectual property rights is critical to sustaining economic growth across all industries and globally;

Noting further that the proliferation of counterfeit and pirated goods, as well as the proliferation of services that distribute infringing material, undermines legitimate trade and the sustainable development of the world economy, causes significant financial losses for right holders and for legitimate businesses, and, in some cases, provides a source of revenue for organized crime and otherwise poses risks to the public; [...]

It’s perhaps not surprising that, if one really believes this, measures can be implemented that lead to bad consequences. We see it so often: people get scared by something, and overreact. I believe, as thinking people, we should be robustly questioning what come across as misleading half-truths contained in this preamble. Before signing up to such a treaty, it should be incumbent on signatories to ensure that the people they represent actually believe in the justifications stated in such a preamble, otherwise there is bound to be trouble.

First, where is the actual evidence that “effective enforcement of intellectual property rights is critical to sustaining economic growth across all industries and globally”? At very least, such a treaty should refer to the literature. I don’t know it, but who does?

So, knowing essentially nothing about the literature, I plunge in via a Google search for “intellectual property” and “economic growth”. One really can’t expect the WIPO literature to be unbiased. And many other academic articles are, of course, hidden behind paywalls, benefiting, … er … the copyright holders … who are only rarely the authors, and much more often the vast wealthy empires of publishing. But then I found one paper on an open website. It is: “International trade, economic growth and intellectual property rights: A panel data study of developed and developing countries” by Patricia Higino Schneider, published in the Journal of Development Economics 78 (2005) 529 – 547. Part of the conclusion is very interesting.

The results regarding intellectual property protection are interesting. They suggest that IPRs have a stronger impact on domestic innovation for developed countries and might even negatively impact innovation in developing countries. These results may be indicative of the fact that most innovation in developing countries may actually be imitation or adaptive in nature. Therefore, providing stronger IPRs protects foreign firms at the expense of local firms.

Even though this is followed by the relatively tame

The policy implication here is not to discourage intellectual property protection in developing countries, but to generate incentives for its strengthening. Innovative activities and IPRs are complementary in nature; therefore, developed countries would benefit by supporting R&D activities in developing countries.

At least, the end of the conclusion

highlights the importance of conducting studies that are inclusive of both developed and developing countries and suggests that pooling together developed and developing countries might lead to misleading conclusions, and consequently to inadequate policy recommendations

And this is from just one article I managed to find. Is that not enough to start casting doubt on the bland assurance of what ACTA “notes”?

That’s only the first paragraph of ACTA.

The second paragraph expresses concern about “significant financial losses for right holders” without questioning the ethics or desirability of this. So what if a right holder is making itself rich exploiting its IP ownership while withholding free useful information and cheap and effective solutions to people who need them? No talk of that, but rather of the cases of “organized crime”. That might remind people of the “war on drugs”, but hasn’t even that fallen into disrepute recently?

And these two paragraphs form the sum total of the explicit justification for ACTA. It strikes me as scandalous that such far-reaching and worrying political conclusions can be based on such a contentious basis.

Yes, of course we don’t want criminals making dangerous counterfeit goods. Let’s encourage our governments to fight that kind of thing that we all agree on, without creating highly problematic treaties and laws based on highly dubious premises.