Analyzing Competency Issues

Competency Issues


This view can be particularly useful in identifying specific remedial education opportunities. The issues of greatest concern are presented at the top of the list. From this summary list you can further assess the impact of competency issues on your organization, and determine your course of action.

 

The Competency Issues view shows the issues ranked, starting with the most significant issues.  Competency issues default as any evaluation questions where 20% or more of all responses were marked as incorrect.  To adjust this threshold to 10% or 30%, you can use the "% Incorrect" filter at the top of the screen.

 

Lightbulb.png

Note the number of responses shown for each question.  
For example, if one question shows a incorrect response rate of 50%, but only has 2 responses, then there isn’t enough data to indicate a problem.

 

Sample Screen: Filter controls are shown in dark grey at the top.  Click them to see all the filtering options.  If you make changes, click the ‘Draw Table’ button to refresh the results.

 

To view the specifics of a particular evaluation question as well as the distribution of answers given by the learners, click the Responses button for the appropriate line in the table.  To see how each of your locations performed on this question relative to each other, click the Locations button.

 

The Domain and Sub-domain filters allow you to show only the evaluation questions related to a particular domain, like RUGs, Care Planning, etc.

 

The Impact column in the table provides an impact score for each question. An impact score is a count of how many Domains/Sub-domains the subject area of the question impacts. For example if a question deals with an assessment item which drives the calculation of a Quality Indicator, RUGs, and three CAPs, it will have an impact score of five.  Clicking on the Impact will provide a summary of that question’s impact.

 

Questions with a chili pepper icon indicate that a short commentary video on this question has been provided by AIS. Click on the icon to view the video.

 

You can sort the table of competency issues by any of the columns by clicking on the column headings.

 

Lightbulb.png

You can remove disciplines from the view to get a different perspective on your data. 

You may expect certain disciplines to answer some questions with a higher degree of success given their responsibilities in the organization.

 

Response Analysis

The Response Analysis lets you drill down to the details of any question and how it was answered by the learners.  Use this view to determine whether or not there is truly a competency issue, or to determine the impact of a competency issue.  By reviewing the question in detail you can determine whether the incorrect responses most commonly selected by learners are the result of acceptable levels of error, or if they represent a significant misunderstanding of an RAI concept.

 

By reviewing the incorrect responses, you can also better determine the impact of that issue.  If the incorrect response chosen could cause a quality of care issue to be overlooked, or resourcing and reimbursement to be unduly impacted, this view will let you prioritize your remedial education.

 

 Sample Screen:  Filter controls are shown in dark grey at the top.  Click them to see all the filtering options.  If you make changes, click the ‘Draw Chart’ button to refresh the results.
Note that the full question text and a clinical rationale for the response are shown when you select a question.
The chart shows the number of times learners selected each response.  The correct answer is shown in green.

 

 

 

Lightbulb.png

Click the bars of the chart to reveal the percent of learners who selected this option, as well as details about the total number of responses.

 

 

Issues By Location

The ‘Issues by Location’ chart shows how each location performed in answering the question selected in the filter area.  Performance is shown by charting the percent of incorrect responses at that location.  Use this view to determine if there are areas or locations who understand the RAI concept more than others.  Finding the root cause of this success might help you employ similar methods of education in the locations experiencing difficulty.

 

Lightbulb.png

If more than one Region is selected in the filter criteria, the resulting chart will summarize results at the region level.  

If only one Region is selected, then results will be shown by individual location.

 

Sample Screen: Filter controls are shown in dark grey at the top.  Click them to see all the filtering options.  If you make changes, click the ‘Draw Chart’ button to refresh the results.