Simon Grant of CETIS

I’ve only been hearing and thinking about plagiarism in the last few days - since going to the Assessment Think Tank in York in fact, but since then reading in many places. One of the debated ideas is encouraging students to use plagiarism detection services. Another, heard at York, is that the more adventurous students run more risk. Why? It is unlikely in some subjects (say Philosophy) to come up with entirely novel ideas, so if a student has an idea which was not represented on the reading list, they are less likely to know if someone has had it before, and thus more likely to be judged to have plagiarised - have passed off some ideas as theirs which actually came from someone else. They may not have known that, but they can’t prove it.

Those two ideas together spark off a bigger idea.

Sophisticated plagiarism detection services could be rebranded to be thought of as tracing the intellectual heritage of a piece of work. That would be very useful - I could write some thoughts down, submit them, and be returned a list of similar ideas, along with how my ideas relate to theirs (according to the software, which is not of course going to be perfect). Then I could look up the originals, and work them in properly: paraphrase and reference, for example. It would also be a powerful self-critical tool: instead of simply imagining the objections to one’s own supposedly new idea, one could see how others have argued against similar ideas in the past.

Incredibly useful in the field of patenting, as well, I would guess…

Have the anti-plagiarism people got on to patents yet? I’ll ask.

Assessment think tank, at The Higher Education Academy, York, 31st January to 1st February 2008

Several of these events appear to have been arranged, and this one was with the Subject Centres both for History, Classics and Archaeology (HCA), and for Philosophy and Religious Studies (PRS).

Around 20 or so delegates were present, mostly from representative subject areas, but including from the JISC’s Plagiarism Advisory Service. Previously, I only recognised Sharon Waller from the HEA, and had talked with Costas Athanasopoulos (PRS Subject Centre) at the JISC CETIS conference: he was the one who invited me.

I won’t try to document the whole event, but to pick out a few things which were highlights for me.

The discussion around plagiarism was inspiring. There was very little on the mechanics and technology of plagiarism detection (Turnitin is popular now) and plenty on good practice to avoid the motive for plagiarising in the first place. This overlaps greatly with other good practice - heartening, I felt. George MacDonald Ross gave us links to some of his useful resources.

Also from George MacDonald Ross, there was an interesting treatment of multiple-choice questions, for use preferably in formative self-assessment, avoiding factual questions, and focusing on different possible interpretations, in his example within philosophy.

As I’m interested in definitions of ability and competence, I brought up the issue of subject benchmarks, but there was little interest in that specifically. However, for archaeology fieldwork, Nick Thorpe (University of Winchester) uses an assessment scheme where there are several practical criteria, each with descriptors for 5 levels. This perhaps comes closest to practice in vocational education and training, though to me it doesn’t quite reach the clarity and openness of UK National Occupational Standards. Generally, people don’t seem to be yet up to clearly defining the characteristics of graduates of their courses, or they feel that attempts to do that have been poor. And yet, what can be done to provide an overall positive vision, acceptable to staff and student alike, without a clear, shared view of aims? Just as MCQs don’t have to test factual knowledge, learning outcomes don’t have to be on a prosaic, instrumental level. I’d be interested to see more of attempts to define course outcomes at relatively abstract levels, as long as those are assessable, formally or informally, by learner, educator and potential employer alike.

One of the overarching questions of the day was, what assessment-related resources are wanted, and could be provided either through the HEA or JISC? In one of our group discussions, the group I was in raised the issue of what a resource was, anyway? And at the end, the question came back. Given the wide range of the discussion throughout the day and a half, there was no clear answer. But one thing came through in any case. Teaching staff have a sense that much good, innovative practice around assessment is constrained by HEI (and sometimes wider) policies and regulations. Materials which can help overcome these constraints would be welcome. Perhaps these could be case studies, which documented how innovative good practice was able to be reconciled with prevailing policy and regulations. Good examples here, presented in a place which was easy to find, could disseminate quickly - virally even. Elements of self-assessment, peer assessment, collaboration, relevance to life beyond the HEI, clarity of outcomes and assessment criteria, etc., if planted visibly in one establishment, could help others argue the case for better practice elsewhere.