Nick Smith of EAM Consulting looks at using the Kirkpatrick Four Levels to help with building the business case for a T&C initiative in your firm.*
To make the business case for a T&C initiative we need build a “chain of impact”. One that shows the budget holders clearly and credibly how the various aspects of the T&C initiative will play their part in delivering the desired business results. But how to do this? What links are needed in this chain of impact?
One way to do this is to use Kirkpatrick’s Four Levels but as a planning tool rather than just as a post event evaluation tool. To do this we need to start at Level 4 and determine what the beneficial business results from the initiative should be. Then move to Level 3 and determine who needs to do what and by when to deliver these results. Once we know what needs to be implemented by those involved we can determine what new capability (such as knowledge, skills or tools) is required at Level 2. Finally we need to decide how best to present the initiative to those involved in it to get a favorable reaction at Level 1 such that they regard it as relevant and important to their roles and intend to implement it. Without the engagement of those involved out initiative is unlikely to deliver the desired results.
Although this is a described above as a linear process it is in practice an iterative one. As we work down the levels it is usual to find that other benefits at the next level up suggest themselves. For example we may realise that the implementation of a new skill at Level 3 may produce not only the desired result at Level 4 but also other beneficial results. For example an initiative designed to reduce rework rates could also free up time for both those in the checking department and the originators of the work. This is also likely to reduce overall completion times.
Once we have developed our chain of impact we need to work up the items at each level into specific, measurable and time-bound objectives. The first step in this process, I would suggest, is to identify the data that will be used as the measures for the objectives at each level. The data for the Level 4 objectives should already exist. It is very likely that the business already collects and reports on these results. What we will need to do is to find out who we can get the data from. At Level 2 we can design validation tools to confirm that the required capability has been attained. These tools might be tests, role plays or overt workplace observations for example or less formal approaches can be used. Level 1 is often measured using a simple questionnaire but other, less formal, approaches can also be used. It is determining the measures to be used at Level 3 that is the most likely area to cause difficulties. Nonetheless, without this vital link in our chain of impact we cannot demonstrate that the capability attained through our initiative at Level 2 has played any part in achieving the results at Level 4. At Level 2 we have confirmed that the participants can do it. At Level 3 we need measures that confirm that they are doing it as part of their routine practice, even when no one is looking.
The best way to ensure that our Level 3 objectives are robust and the measures are appropriate is to structure the objectives in the format “who will do what by when”. For example if we are introducing a new format for supervisory reviews (one to ones) then an initial objective might be:
Supervisors will carry out a supervisory review using the new review format with three of their supervisees within 6 weeks of the completion of the training in the use of the new format.
The measure for this objective could include a review of the records of the meetings but these would not confirm that the new format was actually used in the meetings. Such confirmation could be achieved by asking both the supervisors and supervisees about how the meetings went. Whilst the above example is a good initial objective other objectives will be needed for the ongoing application of the new format for supervisory reviews. The chances of the initiative succeeding will also be enhanced if we identify and build in positive reinforcement to support and encourage implementation.
It is generally accepted that increasing professionalism is a key part of rebuilding trust in financial services. One element of this increase in professionalism is the attainment of higher qualifications by advisers. So what might our chain of impact include for an initiative to raise the qualification level of our advisers?
The first point is to recognise that attaining further qualifications is a measure of increased capability at Level 2. This increased capability needs to be applied in some way (Level 3) if the business is to benefit (Level 4). So we need to determine what people will do with the enhanced capability. This may include gaining authorisation in new advice areas but this too is an enhancement of capability at Level 2.
It is the advisers taking clients through the advice process in the areas covered by their new qualifications that will produce results. These results might be advice given for which a fee is charged or advice given and implemented. The table below sets out some example objectives for the advice strand of a qualifications initiative.
For the advisers to have leads for appropriate clients (an element of their capability at Level 2) the initiative will also need to include a marketing strand. However, the production of appropriate leads for the advisers will be a result (Level 4) for the marketing initiative produced by the marketing activity undertaken (Level 3). To avoid confusion it is simpler to create chains of impact for different strands separately. Within each strand it is critical to identify who will do what and by when at Level 3 that will produce the desired results.
There will also be other areas of the business that will be affected such as those involved in authorisation and those who check any advice given.
An experienced business process consultant Nick has wide ranging experience of managing, auditing, designing, administering and delivering training strategies and events to enhance human capital to address defined business needs. Nick works with Professional Academy in helping companies to measure the ROI of in company training structures. If you would like to discuss ROI training or bespoke in house training for your management, sales or marketing teams please do not hesitate to contact our in company training team or download an Training and Development Brochure at any time.
*Originally published in T-C News October 2015