Reviewing Evaluation Performance

This category of reports allows you to analyze how many evaluations your learners are attempting and how well they are performing on them.  It allows you to track overall learning progress and allows you to get an idea of how learners are progressing towards their required learning.

 

Lightbulb.png

If you adjust your filter criteria at the top of a report, these settings will be preserved as you move to other Evaluation Performance views.  This will allow you to take many different views of the same locations and evaluations.


Activity By Location

The ‘Activity by Location’ view is useful if your objective is to have learners to pass an evaluation or set of evaluations by a given date.  This view shows you roughly how each location is doing with respect to such an objective, without overstating activity by counting multiple attempts of learners.  This view shows the number of evaluations attempted at least once by the learners at each location with only the most recent attempt displayed in this view.  The most recent attempt will show in either the green (passed) or red (failed) column.  Summary information is shown below the chart.


Lightbulb.png 

If more than one Region is selected in the filter criteria, the resulting chart will summarize results at the region level.  
If only one Region is selected, then results will be shown by individual location.

 

Sample Screen: Filter controls are shown in dark grey at the top.  Click them to see all the filtering options.  If you make changes, click the ‘Draw Chart’ button to refresh the results.

 

Attempts By Location

Attempts By Location shows the average number of attempts taken to pass the evaluations.  If multiple evaluations are selected for display, all evaluation data will be averaged.  This data is presented by location so you can compare the performance of locations relative to each other.  This can help identify locations that are having difficulty and help you target remedial education.

 

 Lightbulb.png

Set your filter criteria to target specific evaluations where learners typically have difficulty. 
You may see more meaningful separation of the location results.

 

Sample Screen: Filter controls are shown in dark grey at the top.  Click them to see all the filtering options.  If you make changes, click the ‘Draw Chart’ button to refresh the results.

 

If discrepancies in performance are seen, first see if there is a simple explanation like a small number of learners in one location affecting the average.   For example, if the average attempts in one location is 1.0 and another is 1.6, it may be because the location with the average of 1.0 only had one learner go through the evaluation and passed on the first attempt. To find out how many evaluations make up the average shown, click the bars of the chart.

 

Grades By Location

Grades By Location shows the average grade of learners on their first attempt of each evaluation to help you compare the performance of locations relative to one another.  This can help identify locations that are having difficulty and could benefit from remedial education.


Lightbulb.png 

If more than one Region is selected in the filter criteria, the resulting chart will summarize results at the region level.  If only one Region is selected, then results will be shown by individual location.

 

If discrepancies in performance are seen, first see if there is a simple explanation like a small number of learners in one location affecting the average. For example, if the average grade in one location is 95% and another is 68%, it may be because the location with the average of 95% only had one experienced learner go through the evaluation.  To find out how many evaluations make up the average shown, click the bars of the chart.

 

 Lightbulb.png

Set your filter criteria to target specific evaluations where learners typically have difficulty. You may see more meaningful separation of the location results.

 

Sample Screen: Filter controls are shown in dark grey at the top.  Click them to see all the filtering options.  If you make changes, click the ‘Draw Chart’ button to refresh the results.

 

 

Attempts By Evaluation

Attempts by Evaluation charts the percent of learners who passed the evaluations on either their first or second attempts.  This chart can clearly show where evaluations learners are having difficulty with and can indicate where more preparation and education is needed.  If a high percentage of learners are not passing on their first take, or requiring more than two takes to pass, learners are likely becoming frustrated. Learners should be encouraged to review the eTraining between takes and to make use of the feedback they receive at the end of each evaluation which tells them where they are making errors and points them to the right training materials.

 

Finally, poor performance on evaluations can help you focus your investigation through the Competency Issues view. Instead of prescribing general remedial education, you can drill into the specific questions and concepts causing poor performance, and target problem areas with efficiency and precision.

 

 

Sample Screen: Filter controls are shown in dark grey at the top.  Click them to see all the filtering options.  If you make changes, click the ‘Draw Chart’ button to refresh the results.  

Detail view:  Each bar provides three pieces of information.  Click on the bars to see the exact numbers for each segment of the bar. 



Only learners who have passed an evaluation are included in this chart.  It is obviously not possible to predict how many attempts it will require to pass for these learners.  The gap at the top of each bar shows users who did successfully pass an evaluation in three or more attempts.  For example:

 

If two learners have taken an evaluation with the first one passing on their first take and the second failing their first attempt and not yet making a second attempt, this chart will show that 100% of learners passed on their first take.

 

Note also that with small numbers of learners, the data may not be entirely useful when represented as percentages.

As with most statistics, you should always be careful when drawing conclusions from small amounts of data.

 

Grades By Evaluation

The Grades By Evaluation view shows the average grade on the first take of each evaluation.  This view compares evaluation performance which can help you determine if there are some subject areas where learners need more preparation or instruction on.


Lightbulb.png 

Depending on the different disciplines you've instructed to take the evaluations, you can remove disciplines from the view to get a different perspective.  
You may expect certain disciplines to achieve higher grades for certain evaluations if that topic is a core part of their responsibilities.

 


Click on the bars of the chart to reveal the number of evaluations completed which contributed to the average grade data.

 

Sample Screen: Filter controls are shown in dark grey at the top.  Click them to see all the filtering options.  If you make changes, click the ‘Draw Chart’ button to refresh the results.