Key Performance Indicators (KPI's) for course participants, moderators and mentors
Before embarking on any project, it is worth spending time thinking about what success looks like. That may sound like an obvious statement, but all too often the definition of success is left as an assumed part of the jigsaw and that can lead to misunderstandings and an unwitting failure to work towards a common goal. As with the picture of the honeycomb, success can be seen to come from parts of a process working together.
Once you have defined goals in place the next step is to ensure that you can measure performance against those targets. To achieve this there needs to be a set of quantifiable objectives.
Understanding the effectiveness of learning is a case in point. What does success look like on a distance learning course? Some people will adopt a simple approach to this and say that the only thing that matters is the final result. In other words, have x% of candidates passed the assessment phase. This may be an easy aspect to measure, but by understanding the other metrics that are available it should be possible to include some other useful information which helps towards the final target.
Where the only measure is the final assessment, there is often a tendency towards unnecessary costs as, for instance, retraining is offered despite the fact that there may have been a simpler, faster and cheaper alternative. Equally, if candidates are passing the final assessment with little reference to the learning material then perhaps the test is simply too easy. By looking at the results in isolation vital clues as to the effectiveness of the course may be missed.
Moderators and mentors on the Coracle Learning Line have access to real-time graphical and downloadable dashboards showing important information relating to a candidate's progress on an activity. These Key Performance Indicators (KPIs) ensure that where a candidate needs help, the assistance is offered from a moderator who has a clear picture of where the help needs to be targeted.
For organisations, the use of KPIs from the Learning Line provides a quick and simple way of updating management on the performance of the system against the predetermined success factors.
Typical KPI data provided by the Learning Line includes data relating to items such as:
- registration details (numbers by day/week/month)
- numbers of assessments taken
- assessments passed/failed
- badges awarded
- progress through activities (by day/week/month)
- inactive users
- most viewed pages within activities
Where there are specific requirements from an organisation for KPI data Coracle are available to discuss developing reports to fit the brief.
Lastly, having real time KPI data allows moderators and mentors to target help to candidates and make best use of the Learning Line’s powerful social media style messaging and commenting system.