Posts Tagged ‘analytics’

Student Progression: Smartcard Bursaries and the Students FIRST Project

Monday, October 15th, 2012

Photo of a brass compassThe JISC funded Students FIRST Project has been improving the use of bursary schemes for purchasing learning materials and other services at the University of East London and Anglia Ruskin University, in conjunction with AMOSSHE and John Smith’s Booksellers.

Challenges

The Students FIRST project pulled together a group of technologies - financial information app, bursary on a smarcard, and social messaging tools (texting) - to help improve progression and retention. However, there were some challenges in this approach:

  • technologies, such as smartcard or mobile apps, may be used in a “scattergun” approach and need to be part of a strategic service delivery
  • staff can be unwilling to engage with new technologies; for example, because they don’t want to remember additional logins
  • staff must be trained in the use of any new technologies, but it can be difficult to find the resource to do so.

Benefits

Access to the bursary is staggered according to student progression; i.e. a student must progress to the second year of their studies in order to receive the second installment. Students can then purchase from a list of products specified by their institution, such as books, art materials, nursery fees, campus accommodation, etc. Almost 74% of students surveyed at one university found that the bursary was beneficial. Other benefits include:

  • establishing a clear link between the spend on books and academic achievement
  • a targeted bursary encourages students to achieve and progress
  • such a bursary also equalises opportunity across the student body; for example, one student said “I have access to books that otherwise I wouldn’t be able to own and progress further”.

Recommendations

A collaborative approach to this project was taken with a mix of educational and commercial providers and this gave the project team the opportunity to draw up guidance materials on working across different sectors. Recommendations include:

  • taking a service design approach can help you to understand student needs, expose failpoints in service delivery, and build collaborative relationships between departments/institutions and providers
  • sharing data between institutions can be a cause for concern, so consider alternatives such as using separate hard drives to store data
  • actively engage with technologies with which students are familiar, such as mobile apps, to encourage engagement.

Further Information

If you would like to find out more about this project, the following resources may help:

Student Retention: Student Dashboard at University of Southampton

Thursday, October 11th, 2012

Photo of a brass compassThe JISC funded Southampton Student Dashboard Project at the University of Southampton has been aggregating data from across a number of systems and presenting it in a single place, so that pastoral tutors can provide better informed support for students.

Challenges

Data held by institutions is not always easy to access. For example:

  • data held across a number of systems only offers a partial or disjointed view of information that may be relevant to staff and students
  • multiple systems require multiple log-ins; for example, Student Services at Southampton need to switch between four different applications in order to amalgamate student information
  • selecting the data that tutors might need to see on a dashboard can be contentious; for example information from Finance or Student Counselling services.

Benefits

In common with other projects that have focussed on using data to identify “at risk” students, the project team identified the following benefits:

  • providing a complete view of an institution’s student data enables staff to identify any early signs of problems and possible non-progression
  • improving access to data can encourage the organisational culture to be more innovative and transparent
  • by allowing a small set of data to be shown to pastoral tutors, it is expected that this will generate requests for more data to be included.

Recommendations

Encouraging people to open up access to data can be challenging. Issues of data access and organisational culture can be difficult to handle, so try to:

  • manage change carefully to ensure that all stakeholders are engaged, especially those who have power to implement change and those who have influence over opinion in the institution
  • identify champions in each group of stakeholders, who will help drive through changes
  • find out what data is held by each stakeholder and how it is accessed (some of it may be paper-based) as this can help determine how that data could be accessed in a dashboard; it can also expose information that some stakeholders didn’t even know existed.

Further Information

If you would like to find out more about this project, the following resources may help:

Student Retention: Project fulCRM at Roehampton University

Tuesday, October 9th, 2012

Photo of a brass compassProject fulCRM, funded by JISC, at Roehampton University has brought together two existing processes, one technical and one manual, in order to reduce the number of students leaving their course early.

Challenges

The initial challenges faced by the project team included:

  • over 2000 mitigating circumstances requests were made each year by students in the University, which were all handled manually
  • lack of consistency in the way in which mitigating circumstances were handled, which was a cause for student concern
  • data formats that are not designed to integrate with other applications.

Benefits

Two existing processes (a spreadsheet-based Early Warning System of lack of attendance and other indicators and the manual process of applying for mitigating circumstances) have been improved by taking a technological approach. This has resulted in a number of benefits for staff and students alike, including:

  • improved communication by ensuring that students are kept informed via e-mail of the progress of the mitigating circumstances process
  • flagging up of students who need additional support
  • automated data collection which has replaced complex and time-consuming activities and reduced staff workload.

Recommendations

Students now feel that the technological improvements provide them with a safety net and they will also be able to view their performance alongside their tutor. However, arriving at this stage has not been easy and the following suggestions may help:

  • in order to gain acceptance across a number of disparate Departments, ensure that any system can cater for the creation of different student performance indicators
  • if data (such as data relating to the number of times a student accesses a VLE) is held in the cloud, accessing that data and moving it across to private university servers may pose a security risk, therefore additional servers with secure links direct to the VLE may need to be built
  • do not underestimate the amount of manipulation required to access complex data which is often housed in various disparate systems.

Further Information

If you would like to find out more about this project, the following resources may help:

Student Retention: Learner Analytics at Loughborough University

Monday, September 24th, 2012

Photo of a brass compassThe JISC funded Pedestal for Progression project at Loughborough University has focussed on bringing together information from their in-house Co-Tutor dashboard and other systems to help tutors be pro-active in their response to “at risk” students.

Challenges

The project team found that having access to the data is not enough, there needs to be a balance between automated and human interventions, for example:

  • educational data mining is complex and will be unsuccessful if used solely to identify “at risk” students without human intervention processes being designed
  • incorporating more student-centred approaches into the development of exisiting systems (such as VLEs, student data systems, attendance recording systems etc) can be challenging
  • changes in processes and the introduction of new software systems can be seen as threatening to staff.

Benefits

The project team looked at both staff and student needs by:

  • using service design techniques to help identify learner needs, such as flexibility of study, planning of deadlines for coursework, and employability, for example
  • providing more and better quality learner information to help a tutor be more active in identifying and supporting “at risk” students; for example teaching sessions where attendance is taken electronically are designated as being “critical” or not, so e-mails are sent only to students missing “critical” sessions
  • developing a standardised process for managing placements across three departments in order to reduce student anxiety around the process.

Recommendations

The relationships that students have with staff are vital to the enhancement of the student experience, but the relationships that staff have within in the organisation are also important. For example:

  • provide staff with access to learner data to help them identify any human interventions that need to be made
  • use the student voice to influence improvements
  • sincere management buy-in is critical, otherwise an institution’s organisational structure will remain a barrier no matter what improvements are suggested.

Further Information

If you would like to find out more about this project, the following resources may help:

Student Retention: Engagement Analytics at University of Derby

Tuesday, September 18th, 2012

Photo of a brass compassThe University of Derby has been scoping early indicators (engagement analytics) for spotting students at risk of withdrawing in their SETL (Student Experience Traffic Lighting) project.

Challenges

Institutions generally hold a vast array of data about students, often in different systems which are not always interoperable. The data challenges experienced in this project include:

  • predisposing factors, such as responsibility as a carer, means that students are more likely to withdraw from their studies, however it’s not always possible to capture this type of data as it’s not generally held in any IT system
  • there is little interoperability between different data systems; for example, the data required to populate an engagement dashboard is held in at least seven different systems at the University
  • each student is an individual who brings with them individual challenges to succeeding at and engaging with higher education

Benefits

Scoping out the type of data to be included in a dashboard of core engagement data:

  • means that staff would be able to view a student’s level of engagement with the institution; for example, linking data on absences, access to the library and the VLE (Virtual Learning Environment) could help a tutor see if the student was still engaging in the course, even if they were absent due to illness
  • has produced a change of thinking in the way students at risk of withdrawing will be supported at the University; i.e. it will be more proactive than reactive
  • has helped staff identify key points in the student lifecycle where students are most likely to be at risk of withdrawal.

Recommendations

Engagement analytics goes beyond the hard data recorded in learning analytics, because:

  • it’s dangerous to make decisions about student engagement based solely on a set of data, as understanding the context of the data is important and developing the relationship between the tutor and student is essential
  • both staff and students find it useful to have their own customisable engagement dashboards
  • soft data that can’t always be found on institutional systems should also be recorded and considered.

Further Information

If you would like to find out more about this project, the following resources may help: