Lecture Capture metrics
Do you know that if you are listed as the instructor in the Lecture Capture system you can review Lecture Capture metrics to review what students are watching and what they are watching a lot!
Here is some anonymised data to show what metrics are available to subject coordinators. The bar graphs give a broad view of the metrics where you can see the number of viewers and cumulative views, by ‘echo’ (individual recording) or by week (Note: that a recording is referred to as an ‘echo’).
To get access to this data, you need to be the staff member associated with the subject in both the LMS and Lecture Capture systems. If you are not listed as the instructor in the Lecture Capture system, you still have access to all the recordings but none of the metrics. LMS subject co-ordinators can request to be instructors in the Lecture Capture system via a Lecture Capture support request.
For each recording, the metrics let you go deeper by providing a heat map with varying colours depending on the frequency that a recording was watched. The differing colours indicate the time points in recordings when students were more/less interested in the content. If there is a ‘hot-spot’ (indicting high frequency of repeated views) in the recording, this might indicate a technical issue (eg: the lecturer walked away from the microphone so it was hard for students to hear) or perhaps a new concept was being introduced and students felt the need to watch that part of the recording a few times to understand it.
As a staff member, you can click the hot-spot and be taken directly to that portion of the recording. This can allows further exploration of that content and perhaps enables staff to determine concepts that students are finding difficult and that may need further exposition. The image below shows the hot-spots marked in red, indicating frequently viewed sections of the recording.
The ‘Average Completion’ helps you gauge the level of student viewing of the recording relative to other recordings. It is calculating by averaging the completion rates of all students of the particular recording. Say that student A watches the entire recording (every scene), generating a completion rate of 100%. Student B watches only half of the scenes, generating a completion rate of 50%. If no other students watch the recording, the ‘Average Completion’ is 75% for the particular recording.
By clicking on the ‘Reports’ tab you can also access information about the various recordings in a table, showing the number of times each has been viewed, the completeness of the viewing, and whether it has been downloaded. The last figure is of interest – once a student downloads the recording to their device, they are no longer contributing to the metrics – the metrics available to staff members represent only those students who stream the recordings online.
Finally, we can review the metrics for an individual student. In this anonymised example, we can see the variety in this student’s watching of recordings with some that have never been watched online.
These tables can be exported to Excel or CSV for further analysis. For subjects with large student numbers please contact the Lecture Capture team for further assistance.
Please lodge a Lecture Capture support request if you have any questions .
Metrics bonus section!
Someone is bound to ask how these values are generated…
- A ‘view’ is defined as any continuous viewing for a given user and a given presentation with a 10 minute timeout. This means that if the user comes back into the presentation within 10 minutes of the last time they viewed that presentation, it will be logged as a single view. Downloads and views on mobile devices are not included in viewing data.
- ‘Usage data’ (heat map data) is sent once every few minutes to the server as the player is running.
- The ‘heat quotient’ of a segment is determined by analysing the number of views received for a segment.
- Echo divides the presentations up into segments for analytic reasons and keeps track of how many times users cross segment boundaries. The ‘average % viewed completion’ is calculated as the total number of segments viewed divided by the number of cumulative views of the presentation.
- ‘Viewing data’ is sent to Echo every 90 seconds. For this reason, metrics for presentations less than 3 minutes duration (eg: a quick demonstration recorded with Personal Capture) will have reduced accuracy. A student might watch an entire 2.5-minute presentation but only the first viewing data set is sent before they close the browser, so metrics will show only 50% watched. For most lectures which are ~55 minutes or longer, this is not an issue.
Get in touch