Professional Documents
Culture Documents
Competency Unit 4:
Plan a Training Needs Analysis
TR-HRD-401C-1
Learner Guide
2010
Version No: 1.0
Version Control Record
Copyright 2010, Institute for Adult Learning. All rights reserved. This document is provided for the
explicit use and guidance of learners of Diploma in Adult and Continuing Education (DACE) programme
with the Institute for Adult Learning (IAL). Any other use of this document or parts thereof, including
reproduction, publication, distribution, transmission, re-transmission or public showing, or storage
in a retrieval system in any form, electronic or otherwise, for purposes other than that expressly
stated above without the express permission of WDA is strictly prohibited.
For enquiries and feedback about this competency unit, please email info@ial.edu.sg
2010
Version No: 1.0
TABLE OF CONTENTS
Overview of Module 4
Performance standards
Using the Learner Guide
Self assessment
6 References 93
7 Resources 95
1. Competency Standard: Plan a Training Needs Analysis
2. Generic questions 97
3. Case Study Introduction 99
4. Data Collection Planning Guide 101
5. Learning Review 103
6. The Program Evaluation Standards A Summary 109
7. The Three Step Strategy by Charles Jennings 111
8. Post-course self assessment 115
9. TNA Competency survey 116
8 Glossary 117
Welcome
Welcome to Plan a Training Needs Analysis. It is one of the seven core modules of
the Diploma in Adult and Continuing Education program (DACE) and is a 2-credit
value module of 21 hours class contact time.
Performance Statements
PS1
Establish the scope and requirements of a Training Needs Analysis to meet
stakeholders needs.
PS2
Prepare for Training Needs Analysis using appropriate information.
PS3
Select appropriate methods to collect data for Training Needs Analysis.
PS4
Select appropriate methods to analyse collected data
PS5
Prepare a Training Needs Analysis report
Underpinning Knowledge
1 Organisation objectives and business needs
2 Concept of performance improvement
3 Scope and process of TNA
4 Types and sources of information in organisation
5 Methods of data collection
6 Methods of data analysis
7 Ethics in the use of data
8 Trends and developments in TNA
Introduction
A progressive case study starts with a client request and provides the
context for learners to apply new knowledge and skills in relation to
preparing a TNA project plan, data collection and analysis and writing a
TNA report. Ethical issues, common obstacles and trends and
developments in needs analysis are examined.
Our Approach
1. make regular entries in your journal and/or log into other forums
to record how you think, act and feel about eg what is happening
in your modules, what topics are being covered, your opinions
and those of peers, what you have learned, how you can apply
what you have learned in your work, how your beliefs are being
challenged, your feelings about this learning journey, what has
surprised or disappointed you, helped you grow, been a barrier,
motivated you.
2. set, review personal learning goals on a continuous basis as you
progress through the program
3. assemble a portfolio of your work by eg including relevant
samples of work or evidences of your competence which reflect
your personal and professional growth
This module has been designed using sound adult learning principles. To
gain the maximum benefit from this experience you are encouraged to
Summary of Assessment
Total
90 mins
Learning Outcome
At the beginning of each section, the specific learning
outcomes which you are expected to achieve are
outlined. It is useful for you to review your learning
against this checklist in preparation for the assessment.
Learning Activity
Reflective Point
A Reflective Point offers questions that are intended to guide
you towards drawing out your own experiences and linking
these to the learning points. Time spent on the reflection
questions will help you surface your personal values, beliefs
and assumptions about your professional practice as an Adult
Educator. You are strongly encouraged to do the exercises as
your discoveries will serve as useful contributions for the
reflective portfolio component of the assessment.
The first ranking is a self-assessment regarding your level of knowledge and skill
(1= I dont know very much about this subject, 5 = I am expert in this subject)
The second ranking is the importance of each learning outcome to you, based on your job
responsibilities (where 1 = not important at all, 5 = critical).
A B
Learning Outcomes My current Importance to
knowledge me
I am able to (1-5) (1-5)
1. What is a TNA?
Scope and 2. Purpose
requirements 3. Performance improvement
of a TNA 4. Approaches
5. Phases in a TNA process
Data collection
methods
Data analysis
methods
Prepare a TNA
report
Most experts agree that effective learning, training and performance improvement
initiatives should start with a needs assessment. The section begins the process of
examining what a TNA is by discussing definitions, approaches and phases of a
training needs analysis within a framework of performance improvement.
Learning Outcomes
Terms used
TNA defined
Performance Improvement
a business need,
driving a performance need
identifying the specifics regarding the desired training,
and
identifying the non-training issues (that affect the
performance situation)
One way to scope the features of needs analysis is to examine the similarities
and differences of training requests that would lead to needs analysis. Gupta et
al (2007) describe the following similarities:
1. Dissatisfaction with the current situation and desire for change i.e. a gap
exists between what is and what could/should be.
4. Include little evidence and few clues about whether taking the requested
action will improve learning or performance. Information about the situation
and course of action are unknown. Most requests that lead to needs
assessment include fuzzy goals, incompatible beliefs, flawed assumptions,
large leaps in logic, little diagnostic information e.g. about what caused the
current condition and what is needed to make the required changes or what
support is needed.
Purposes of TNA
Benefits of TNA
A Useful Framework
Stages
Business
Performance
Learning
Learners
The result of this approach is that the needs analysis study leads to
training recommendations and non training interventions, all of
which will support job performance and organisation goals.
The TNA approach used in this module, and reflected in the design,
delivery and evaluation of the learning has a focus on business,
performance, learning and learners.
Approaches
Gupta et al (2007) propose four needs assessment approaches which can be used
separately or in combination:
Approach Purpose
Job and to gather information about the scope, responsibilities and tasks
Task for a particular job function or functions.
Analysis to guide the development of new job descriptions and the revision
of existing positions. Position descriptions help link job
requirements to training needs.
Knowledge to identify the knowledge and skills that people must possess in
and Skills order to perform effectively
to prescribe appropriate interventions to close the knowledge and
skills gaps.
Usually only those gaps caused by lack of knowledge and skills can
be improved through training. Performance deficiencies that occur as
a result of lack of motivation or organisational structure and processes
require non-training interventions.
Approaches, strategies, methods and terms used may vary but the
intended end result of each process is about identifying performance
and learning issues and recommending feasible solutions.
1. Identify stakeholders
2. Determine needs
Business objectives
Performance needs
Identify the attitudes, skills and knowledge (ASK) to
support the first two needs
3. Agreed needs, critical success factors and constraints
4. Develop recommendations
5. Produce report including communication and evaluation
strategies
Learning Activity
You are the in-house training officer in your organisation. You are taking a
coffee break when your department manager joins you at the table.
Repeat Exercise
You are the in-house training officer in your organisation. You are taking a coffee
break when your department manager joins you at the table.
A Reflective Point
A Reflective Point
Additional Reading
Linking TNA to Evaluation
Training
recommendations
A Reflective Point
Rate the importance of each of the TNA purposes identified by Tobey (2005), as it
applies in your organisation on a scale from low to high.
1.
low medium high
2.
low medium high
3.
low medium high
4.
low medium high
5.
low medium high
6.
low medium high
Scope and
requirements
of a TNA
1. the client request
Prepare for 2. the value of a project plan
a TNA 3. planning for data collection
4. types of data
5. data sources
Data collection
methods
Data analysis
methods
Prepare a
TNA Report
This section outlines the importance of aligning training needs to the business,
performance, learning and learner needs of the organisation. It examines how to
handle a client request, the value of a project plan and the steps involved in planning
for data collection. A case study guides learning.
Learning Outcomes
The training function should consider two role responsibilities for needs
analysis. Stone (2009) outlines these as
In the proactive role, the trainer must stay in touch with the current
status of the organisation. Stone (2009) provides a starter list of
some of the elements to follow:
Scoping this initial phase of the needs analysis will reveal information
like the following:
The focus of the initial meeting with the client should be on the results
that must be achieved by the training/learning solution, results that will
improve performance.
Questions to ask
More Questions
Learning Activity
Rank the importance of each of these elements to assess training needs within an
organisation where 1 = most important and 10 = least important. Use each number
from 1 to10, once only. Write your responses in the column My ranking.
My Study Element
ranking ranking
A. Customer opinions
B. Training audits
D. Employee surveys
G. Advisory committee
H. External consultant
I. Skills inventory
J. Supervisors opinions
Based on study by Mathews,B.P., Ueno, A., Kekale, T., Repka, M., Pereira, Z., & Silva,
G. (2001). Quality Training: Needs and evaluation-findings from a European survey.
Total Quality Management,12(4), 483-490. cited in Kupta et al (2005) p 23.
TASK
1. What questions should Andy ask Tracey Tang, the Senior Production Manager to
2. Use Resource 2 and other information in the Learner Guide to help you.
3. Write down your suggested initial questions for client (Tracey) below.
4. Discuss in your group.
5. Select a group member to report back.
Business
Performance
(continued over)
TASK (continued)
Learning
Learner
Plan ahead
4. Do you have the resources to plan and budget for the response to
the TNA?
At the preliminary stages of a TNA, after some initial data has been
gathered to get a general idea of the need, it is important to write a
plan of action or a project plan to help the analysis project stay on
track. This is a proposal for what will happen.
The written project plan also helps align common understandings and
expectations about the process and deal early with
misunderstandings about eg who is doing what, how it will be
conducted, purpose, timeframes etc. Once agreed to (and signed) by
relevant parties, this document serves as a communication tool and a
record of decisions made. It is not a static document and it should
reflect agreed changes as they occur. After one phase, the project
may need to take a different approach and once agreed, this should
be written into the next phase of the proposal.
Gupta et al (2007) offer the following tips for preparing a project plan
Purpose
Phases (steps)
Expected outcomes
Timeframe
Cost estimates
Data Collection
This is the step in which data is collected for each type of need
(business, performance, learning and learners) to establish the need
for training. Most needs analysis relies on multiple-data collection
methods which provide reliable and appropriate data.
Purposes
Types of data
The table below from CIPD (2009) gives some general types of data that may
be collected.
Technology How jobs are done now in terms of organisation and resources
and available. What technologies do people use, and how might this
organisation of change? Changes may also be planned in terms of numbers of
work people to carry out the targeted performance or in terms of the way
they are supervised or managed.
Employee Who is currently employed in the area you are analysing? Are
demographics numbers increasing or decreasing? Who is joining and leaving?
What categories of employees are included?
Past Previous knowledge, skills and behaviours that have been expected
experience in the past and are required currently, linked to the organisations
competence framework. Experience of past training interventions.
Current Current performance levels of individuals and teams and any areas
competence where competence needs to increase, to be measured against both
current and changed roles
Employee How employees feel about change? Will this affect their
attitudes and willingness to learn and acquire new skills? Does the
culture organisation want to change attitudes eg in the way
customers are treated?
Performance What are the specific gaps between the desired and current performance?
How is on the-job performance measured?
How is on the-job performance managed and rewarded?
What tools and resources do the employees need to achieve the desired
performance?
What is a description of the work environment in which performance is
expected
What are the implications in the work environment for transfer of learning
back to the job?
Learner What is their attitude about the job performance being targeted?
What will be the context in which they attend training (e.g. on-the-job, off-
the-job, after work, during work, with manager support or not)?
Tobey (2005)
He has written questions based on his initial conversation with Tracey the client.
TASK A
3. Categorise each question under the appropriate type of need and write out
the question in the appropriate column on the Data Collection Planning
Guide (Resource 4).
TASK B
The process of identifying the best data source for each question is
the next task.
Data sources
Guiding Principles
Sources must match the purpose and needs of the data collection
process. Stone (2009) has outlined five considerations when
determining appropriate sources.
1. Credibility
Credible sources are objective and in a position to know. Credible
sources can be anyone in the organisation who can satisfy the
purpose of the TNA . When selecting credible data sources,
consider purpose, situation and constraints.
2. Convenience
Collect data from the sources at their convenience ie when they
are easily positioned to provide the data, even if this is not ideal
for the overall project time frames.
3. Cost
Recognise the economic implications of time away from work
tasks when gaining cooperation to collect data.
4. Cooperation
Plan how to gain approval to collect data and how to encourage
the willingness of the source to engage in the process.
5. Comprehensive
Use every effort to gain a complete picture to meet the purpose of
the data collection process and to maximise credibility of the
findings and recommendations.
Operational constraints can sometimes impact on what data is
collected or not. Being resourceful and flexible will assist in
managing the process.
People
Clients
Executive management
Operational managers and supervisors
Employee or employee teams/groups
Advisory/reference groups/committees
High performers
Low performers
Learners
Coaches and mentors
Internal and external task experts
Internal and external subject matter experts
Customers
Training professionals
Members of professional associations or organisations
(local, regional or global)
Members of government agencies (local, national)
Members of industry associations
A Reflective Point
Think about a client with whom you worksomeone in your organisation. (client
could mean your boss eg an in-house training manager, or a senior manager
or customer service manager within your organisation; or a client could be
someone external to your organisation)
Scope and
requirements
of a TNA
Data analysis
methods
Prepare a
TNA report
This section continues examining the data planning process by outlining qualitative
and quantitative data collection methods, some advantages and disadvantages for
each, factors influencing selection and guidelines for implementing the data
collection process.
Learning Outcomes
Qualitative Methods
A. Interviews
B. Focus groups
C. Observation
A. Interviews
Advantages Disadvantages
B. Focus Groups
Advantages Disadvantages
C. Observation of Work
Advantages Disadvantages
Quantitative Methods
A Surveys
B Document reviews
A Surveys
Phase 1. Prepare
Establish the goals and outcomes; become familiar with the
situation and typical expressions eg translate technical jargon into
simpler language; observe people at work; review written reports;
decide whether an existing or commercially available survey is
appropriate or a new survey is needed.
Phase 2. Design
Consider the number of people involved. For large numbers use
mostly close-ended questions that can be recorded and analysed
easily by computer.
Consider how the data will be collected. Will it be collected on paper
or via an organisations intranet or internet? A web search of the
term free online survey will produce a number of free tools and
services for creating surveys and collecting survey data.
Consider how the data will be analysed. Responses to online
surveys are often analysed with easy-to-use web-based software.
Paper responses can be analysed by hand counting answers or
surveys can be electronically scanned.
Phase 6. Pilot-Test
It is wise to trial the survey to identify problems in construction
or physical layout. Other issues such as whether the
instructions are clear and concise, whether respondents
understand the questions easily, whether respondents answer
the questions easily, whether respondents have enough space
to record their comments and whether the questions elicit the
responses that address the survey purpose will be clarified. If
the responses do not really address the initial purpose of the
survey, it is best to revise and pilot-test again.
Phase 7. Conduct the survey and follow-up
The survey is ready to launch. Monitor incoming responses
frequently. Non-respondents are a common result. Follow up by
sending reminders.
Surveys
Advantages Disadvantages
soft data questions can yield qualitative respondents can skew results
data, which is tallied as quantitative e.g. by not reading questions
can use a variety of questions formats poor return rate means sample
not large enough
can reach large numbers in short time
little provision for free response
can respond without fear of retribution
lacks detail
B Document Reviews
The benefit of collecting such data is increased when these data are
collected in conjunction with another data-gathering method.
Advantages Disadvantages
TASK
Choose methods that will provide the best data with optimal
expenditure of resources: consider time, financial costs,
essentialness, data source availability, logistics and assessor skill
level.
Are there any fees for external services e.g. for conducting
interviews, transcribing tapes, doing statistical analysis?
(continued over)
Is travel involved?
These suggestions or tips for the needs assessor will help make
the implementation process more effective and efficient.
Andys challenge was to decide which methods will provide the most useful data
and which methods will provide for multiple needs.
TASK
2. Discuss what you think influenced his decisions to make the selections he
did.
What tips and cautions would you offer Andy to help him implement the data
collection process efficiently and effectively? List your responses below.
Scope and
requirements
of a TNA
Data collection
Methods
Prepare a
TNA report
Learning Outcomes
Types of Data
Quantitative data
Qualitative data
Software (such as NVIVO and Atlas) will improve the ease, accuracy
and speed of qualitative data analysis.
5. Omit irrelevant data that does not relate to the analysis and its
objectives
Clients should not be given the impression that training can achieve the
entire business goal. There are too many other factors that can have an
impact. It is feasible for the client and training professional to negotiate
the percentage of change the training alone could achieve.
1. learning objectives
2. indicators for learning activities that will replicate the job environment
3. background information to replicate the job environment for skill
practices
4. test items for knowledge assessments
5. process and product checklists for skill practice assessments
6. how learners value (or not) the skills to be taught
7. other attitudinal information about the learners
Descriptive Statistics
Learning Activity
Descriptive statistics
A knowledge test with 100 items was administered to 20 participants. The possible
score range for the test was 0 (no correct answers) to 100 (all correct answers).
A B C D E F G H I J
Score Score Score Score Score Score Score Score Score Score
98 100 87 63 60 79 87 52 84 91
K L M N O P Q R S T
Score Score Score Score Score Score Score Score Score Score
98 89 87 72 75 59 68 93 80 68
Learning Activity
Exit interviews from employees who left organisation in last 12 months were analysed.
The number of ex-employees represented in the data was 40.
Of these 40 ex-employees, 18 (45% of total respondents) said that low salary was a
major reason for their leaving.
Out of those 18, 10 (56% of the 18; 25% of total respondents) said that lack of
training and development opportunities was a second major reason for leaving.
Findings
TASK A
Findings
TASK B
2. Indicate with an arrow () each finding that was new to the client (Col 4)
Scope and
requirements of a
TNA
Prepare for
a TNA
Data collection
methods
Data analysis
methods
1. elements of a report
Prepare a 2. ethical issues and standards
TNA report 3. common errors and obstacles
4. trends and developments
The final phase in a TNA is preparing a formal report to present the feedback, including
findings and recommendations to the client. The purpose of the report is to persuade
the client to approve the training intervention design and delivery as recommended;
and to take ownership of the non-training issues and recommendations. This section
outlines the key elements of a report, ethical considerations and common errors and
obstacles faced by needs analysts. Trends and developments are summarised
described briefly.
Learning Outcomes
IT (new and old not yet integrated, expensive, not yet ready,
cost of data migration)
Training Recommendations
TASK A
List your training recommendations below. Use the suggested headings in the LG
to help you.
Non-Training Recommendations
TASK B
Ethical Considerations
How well do you know your personal and professional values? When
dealing with ethical issues, it helps to know this as it will affect how you
will act in specific situations.
Utility
Feasibility
Propriety
accuracy
A summary of these standards is outlined in Resource 6.
Accessed on 28 July 2009 from
http://www.eval.org/EvaluationDocuments/progeval.html
1. Add Value
Conduct yourself, and manage your projects and their results, in ways that
add value for your clients, their customers, and the global environment.
2. Validated Practice
3. Collaboration
4. Continuous Improvement
5. Integrity
6. Uphold Confidentiality
Maintain client confidentiality, not allowing for any conflict of interest that
would benefit yourself or others.
1. Systematic inquiry
2. Competence
Learning Activity
Consider the types of evidence that you would look for in order to determine whether
a training needs analysis has been improperly conducted.
Gupta et al (2007) offer the following questions for the needs analyst
to ask:
1 Can the project use the analysts knowledge, skills and abilities?
2 Does the client seek information for making decisions and taking
action, or is the needs assessment window dressing for decisions
that have already been made?
3 Does the decision maker have the power to take action based on
needs analysis information?
4 Do all those who are involved support change?
5 Do the client and project stakeholders act ethically?
6 Are sufficient resources available to complete the project?
If any answers to the above questions indicate there are issues that
will impede progress, agreement has to be reached on how to deal
with the issues before proceeding with the TNA. If timelines are too
short, funding is inadequate, staff involved are behaving unethically
or there is a high probability of no change as a result of the TNA,
then if possible avoid conducting a TNA.
2 Senior management supports the effort, but line managers or supervisors do not
8 Lack of access to those working night shifts or people assigned to restricted work
areas
9 Disagreement among team members about the method to use to implement the
assessment
1. management requests it
2. most admired companies are pursuing it
3. the program is a general trend in all organisations
4. the training and development staff thinks the program is
needed.
Additional reading
The Politics of Needs Analysis
All organisations are political entities. Politics are largely endemic to
every business/organisation. Political intelligence in the context of
change is about politics at work. It is about working with integrity towards
the common good of the organisation.
The needs assessor will benefit by being aware of the role of politics at
work when planning and conducting a TNA. Political intelligence can be
used in a positive way during change. Being politically aware means
being able to recognise the power bases and sources of influence they
possess.
Cook (2005) defines political intelligence as involving:
Cook (2005) suggests the need to watch out for two sets of behaviours
by people involved in the TNA.
1. their attitude towards the project be it positive or negative.
2. their drive towards activity be it active or inactive.
The following diagram by Cotton (2004) illustrates the drive to action
and positivity.
+
YES people Change
Champions
A I would..
T I could.. I will
T I can
I
T
U Change
Victims Terrorists
D
E I wont
I cant It wont
It cant
_
INACTION ACTION
Characteristics
Change champions have a positive attitude to change and are action
oriented.
Change terrorists are characterized by a negative attitude and high
levels of activity which focus on the negative.
Yes people are positive about change but do not follow through with
action.
Victims have a negative attitude towards projects and change but lack
drive and disengage from change.
Being aware of how people are likely to react during a TNA will help
prepare a needs assessor with how to deal with them.
The landscape for TNA and needs assessment in general has changed
greatly in the last ten years (Gupta 2007). Professionals who currently
conduct needs assessments work in challenging times. In todays global
fast-paced world, a TNA needs to be agile, fast and responsive.
1. Performance Improvement
2. Ethical Guidelines
3. Advancing technology
19. Wilson, K. (2006). TNA Final Report. The Victorian Dairy Manufacturing
Sector. Retrieved 11 August 2009 from
http://www.dairysafe.vic.gov.au/index.php?option=com_content&view=article&id=5
7&Itemid=173
5. Review of Learning
Business 1. What current business needs or strategies are being affected or caused by the presenting
needs problem?
2. What business problems exist? (look for measures such as amount of increase or
decrease in business indicators, including turnover, productivity, quality, complaints,
waste, customer satisfaction: If not known, it is critical to find out)
3. What is going on in the external environment that relates to the presenting problems (eg
competition, market changes, government regulations)?
4. What other data exists from within your business that may provide information regarding
this business need eg sales figures, quality, productivity, HR information, benchmarking,
5. What changes are you seeking to achieve with this training intervention? What measures
will tell you it has been successful?
6. What business opportunities are inherent in this business need (eg new products or
markets)?
7. What business strategies are you seeking to support with this requested training
intervention?
6. What else might be getting in the way of employees performing as they should, other than
lack of knowledge and skills (non-training issues)?
7. What will be the nature of management support for job application and practice after
training?
Learning 1. What knowledge and skills do you think the targeted employees need to learn to perform
needs the way they should?
3. How well should they be performing the skills by the end of the training?
Learner 1. What are the targeted learners backgrounds and experience in the subject matter?
needs
2. What are their learning styles?
4. What are the expectations regarding when and how they will attend the training (after
work, during work, paid, unpaid)?
Adapted from Tobey (2005)
Each factory is run by its own production team. (A team leader coordinates and assigns
work to the team members). The team leaders run their production lines and are
responsible for hiring, training and performance management of their teams. All team
members have been trained in each aspect of the production line.
Andy Tan is the Senior Training Officer at the Jurong West factory in Singapore. He has
been told that
Tracey Tang is the senior production manager and part of the senior management team.
She has asked Andy to attend a meeting to discuss an upcoming training need.
The Urban Traveller clothing line will need three new production lines which are
scheduled to start up in 6 months.
Some operations will be similar to existing ones in the factory and a few will be
new processes.
Fifty (50) new employees will need to be hired. Some new employees will work in
the new line and some in the existing line. Some current employees will move to
Urban Traveller line teams and others will remain on existing line teams.
Hiring for the 50 new employees will start in three months. An HR rep will sit on
the panel too.
A Team leader will chair the interview panel that is hiring new staff.
Tracey wants Andy to design and deliver a job interviewing skills training session for the
team leaders by the time the hiring phase starts.
Type of Need Questions to be asked Data Source Potential Data Collection Data Collection
Methods Method
2) What happened?
Resource 5
6) What happened?
Resource 5
2. What happened?
Resource 5
2. What happened?
Resource 5
2. What happened?
Resource 5
2. What happened?
Resource 5
U2 Evaluator CredibilityThe persons conducting the evaluation should be both trustworthy and competent to
perform the evaluation, so that the evaluation findings achieve maximum credibility and acceptance.
U3 Information Scope and SelectionInformation collected should be broadly selected to address pertinent
questions about the program and be responsive to the needs and interests of clients and other specified
stakeholders.
U4 Values IdentificationThe perspectives, procedures, and rationale used to interpret the findings should be
carefully described, so that the bases for value judgments are clear.
U5 Report ClarityEvaluation reports should clearly describe the program being evaluated, including its
context, and the purposes, procedures, and findings of the evaluation, so that essential information is
provided and easily understood.
U6 Report Timeliness and DisseminationSignificant interim findings and evaluation reports should be
disseminated to intended users, so that they can be used in a timely fashion.
U7 Evaluation ImpactEvaluations should be planned, conducted, and reported in ways that encourage
follow-through by stakeholders, so that the likelihood that the evaluation will be used is increased.
Feasibility Standards
The feasibility standards are intended to ensure that an evaluation will be realistic, prudent, diplomatic, and
frugal.
F2 Political ViabilityThe evaluation should be planned and conducted with anticipation of the different
positions of various interest groups, so that their cooperation may be obtained, and so that possible attempts
by any of these groups to curtail evaluation operations or to bias or misapply the results can be averted or
counteracted.
F3 Cost EffectivenessThe evaluation should be efficient and produce information of sufficient value, so that
the resources expended can be justified.
Propriety Standards
The propriety standards are intended to ensure that an evaluation will be conducted legally, ethically, and
with due regard for the welfare of those involved in the evaluation, as well as those affected by its results.
P2 Formal AgreementsObligations of the formal parties to an evaluation (what is to be done, how, by whom,
when) should be agreed to in writing, so that these parties are obligated to adhere to all conditions of the
agreement or formally to renegotiate it.
P3 Rights of Human SubjectsEvaluations should be designed and conducted to respect and protect the
rights and welfare of human subjects.
P5 Complete and Fair AssessmentThe evaluation should be complete and fair in its examination and
recording of strengths and weaknesses of the program being evaluated, so that strengths can be built upon
and problem areas addressed.
P6 Disclosure of FindingsThe formal parties to an evaluation should ensure that the full set of evaluation
findings along with pertinent limitations are made accessible to the persons affected by the evaluation, and
any others with expressed legal rights to receive the results.
P7 Conflict of InterestConflict of interest should be dealt with openly and honestly, so that it does not
compromise the evaluation processes and results.
P8 Fiscal ResponsibilityThe evaluators allocation and expenditure of resources should reflect sound
accountability procedures and otherwise be prudent and ethically responsible, so that expenditures are
accounted for and appropriate.
Accuracy Standards
The accuracy standards are intended to ensure that an evaluation will reveal and convey technically
adequate information about the features that determine worth or merit of the program being evaluated.
A1 Program DocumentationThe program being evaluated should be described and documented clearly and
accurately, so that the program is clearly identified.
A2 Context AnalysisThe context in which the program exists should be examined in enough detail, so that
its likely influences on the program can be identified.
A3 Described Purposes and ProceduresThe purposes and procedures of the evaluation should be
monitored and described in enough detail, so that they can be identified and assessed.
A5 Valid InformationThe information gathering procedures should be chosen or developed and then
implemented so that they will assure that the interpretation arrived at is valid for the intended use.
A6 Reliable InformationThe information gathering procedures should be chosen or developed and then
implemented so that they will assure that the information obtained is sufficiently reliable for the intended use.
A10 Justified ConclusionsThe conclusions reached in an evaluation should be explicitly justified, so that
stakeholders can assess them.
A11 Impartial ReportingReporting procedures should guard against distortion caused by personal feelings
and biases of any party to the evaluation, so that evaluation reports fairly reflect the evaluation findings.
A12 MetaevaluationThe evaluation itself should be formatively and summatively evaluated against these
and other pertinent standards, so that its conduct is appropriately guided and, on completion, stakeholders
can closely examine its strengths and weaknesses.
L&D leaders need to think creatively about business problems to find solutions that arent
always down the same, well-worn track. Charles Jennings offers three steps to help take
advantage of the current economic climate.
There has never been a better time than now for training and development managers to
review their modus operandi for delivering services to their organisations. They should be
taking the time to explore how they can improve both the efficiency and effectiveness of
their teams efforts.
You may ask why now? Well, the answer is that we know during times of change
whether in changing economic conditions, during times of merger or acquisition, or when
management upheavals occur organisations tend to be more open to altering existing
practices or adopting new approaches than they are when the times are good and
organisational life is stable.
Great opportunities
When things become unstuck it is worth listening to the advice of Warren Buffett, a
master of taking advantage in unsettled economic times. Buffett says: Great opportunities
come around when excellent companies are surrounded by unusual circumstances. And
its not just companies but all organisations, whether theyre driven by the need to make
a profit or the need to provide a service.
Training Needs Analyses (TNAs) have done as much as anything else to build and
maintain a gap between training and development professionals and their
business-focused customers.
So, what big changes can training and development managers make in these times that
will result in a positive impact on the value they add to their organisations? To answer this
question it is worth reflecting on what their organisations expect their training and
development departments to do.
For a start, they need to understand that most business managers are not particularly
interested in training and learning per se. Some may be, but they tend to be the exception
rather than the rule. During my career I have only known a very few line managers who
were keen to engage in discussions about instructional design or the advances in our
understanding of pedagogy. As professionals, those of us working in training and
development need to know about these things and behind closed doors we expect to
discuss them.
However, theyre just not topics with which to engage a business manager. That said,
most managers will be extremely interested in the output of the learning process in the
improved performance and productivity of individuals or groups within their remit, and in
the impact of training and development on business results. If they are senior leaders they
will also be passionate about what the training and development department is doing for
the performance of the organisation as a whole.
Training and development managers need to analyse problems that line managers bring
to them differently to the way theyve done so with the TNA model. They need to get to the
root cause of the problem in an open and consultative way and work with the problem
owner to agree the best solutions without thinking about training as the final end point.
In my experience the best solutions sometimes involve learning interventions, sometimes
even courses and programmes, but just as often the presenting problems are best
addressed by changes in working practices, new processes, or even changes in the way
the manager manages!
Step two
The second step managers can take to improve the business impact of training and
development is to ensure that training and development accountabilities and resources
are fully aligned with business strategy. Many organisations flip-flop the organisational
structure for their training/L&D functions from centralized to devolved models and back
again on a regular cycle, always hoping that the organisational change will result in
greater business impact.
However, track records tell us that neither model provides the silver bullet alone. In fact,
organisations in the USA spend about $100 billion on training each year (and have done
so annually for almost the past 20 years) and still only about 10% of that training and
development investment results in transfer to improvements in the workplace.
They need to develop high level performance consulting skills and move away from being
order takers. Some organisations with centralized T&D do well, some not so well. The
same goes for organisations where training and development is devolved into business
units. So the answer doesnt lie in a defined organisational model.
Where the answer does lie, however, is in the development of a robust governance model
for training and development. Every organisation should make sure that it has a
meaningful governance board, or set of governance boards, that set and align the overall
training and development strategy (for the T&D managers to execute), and ensure that
training and development departments are business-driven, agile, innovative, efficient and
effective. The majority of members of the governance boards should be senior business
managers. The boards certainly should not be HR/T&D talking shops.
Step three
The third strategy training and development managers need to adopt is for their
departments to become leaders rather than followers, consultants rather than fulfilment
services. They need to develop high level performance consulting skills and move away
from being order-takers. To be effective they also need to understand whats available to
them in todays toolbox of approaches and, particularly, technologies that can be brought
to bear to build employee capability and help solve identified business problems.
Then, once they have determined whats possible and appropriate, they need to be pro-
active in designing and deploying innovative solutions. Here I would specifically stress the
need for training and development managers to understand the importance that workplace
learning and just-in-time learning (including performance support and business process
guidance) play in improving employee performance, and also the importance of the social
aspect of learning of learning through others and collaboration, and of the many
learning technologies that, given the right circumstances, have the potential to support
workplace and social learning as well as formal learning.
Apart from addressing the issues I have already discussed, training and development
managers need above all to ensure that their own teams are competent, capable and
have the professional skills to deliver a service that provides their organisation with a
training and development service that is a strategic business tool.
To do this, each and every member of their teams needs, at least, to be a competent
specialist in the areas of:
a) adult learning;
b) performance consultancy;
c) learning technologies.
Without these capabilities, any training and development manager will struggle to deliver
real value to their organisation.
Charles Jennings is the former chief learning officer for Reuters and now runs his own
specialist learning and performance consultancy practice, Duntroon Associates.
The first ranking is a self-assessment regarding your level of knowledge and skill
(1= I dont know very much about this subject, 5 = I am expert in this subject)
The second ranking is the importance of each learning outcome to you, based on your job
responsibilities (where 1 = not important at all, 5 = critical).
A B
Learning Outcomes My current Importance to
knowledge me
I am able to (1-5) (1-5)
In Part 1, please rate the importance of the following competencies when implementing an
effective needs analysis, using the key below. Tick the box of your choice where
1 = strongly disagree 2 = disagree 3 = somewhat agree 4 = agree 5 = strongly agree
NA = not applicable
In Part 2, rate your own knowledge and skills and abilities in relation to implementing an
effective needs analysis (where 1 = I dont know much about this to 5 = I am highly skilled & capable)
Part 1 Part 2
Needs assessors/analysts must have 1 2 3 4 5 N 1 2 3 4 5 N
A A
SOURCE:
Resource 9
Assumed skills and Assumed skills and knowledge are skills and knowledge that learners should
knowledge have and are assumed to have before they attend the training programme.
They are outlined in the competency standards.
Competency A competency category refers to the broad area or function in which these
category competencies are mainly found.
Competency level The competency level reflects the level of complexity and depth of learning
required by the competencies in the standard. It is outlined in the
competency standards.
Competency profile The competency profile typically refers to a group of competencies that are
required for a job or a role.
Competency The Competency Standards is a document that refers to the skills, knowledge
Standards (CS) and attitudes needed to perform a job task and describe the acceptable levels
of performance.
Competency unit A competency unit describes a particular work role, duty or function, which
forms the smallest group of skills, knowledge and abilities set able to be
recognised separately for certification.
Continuing Educational programmes for adults, usually at the post-secondary level and
Education and offered as part-time or short courses in occupational subject areas.
Training (CET)
Credit A unit of measure assigned to courses or course of equivalent learning.
Curriculum, The CTAG is a document that provides training and assessment advice to
Training and achieve effective training and assessment.
Assessment Guide
(CTAG)
Continued over
Evidence sources This section gives examples of tasks, observations, documents etc that
can be used as evidence for assessing the particular competency
element. It is outlined in the competency standards.
Generic skills Generic skills are transferable and applicable to all industries.
Learning outcomes The skills and knowledge a learner should be able to demonstrate as a
result of having undertaken training and/or assessment. It must be
measurable, clear and observable.
Occupational skills Occupational skills are job specific skills set that are needed to perform
tasks for a specific sector of an industry.
Range and context Range and context provides the type of contexts to which the
performance criteria apply. They cover items that are achievable or to be
performed across by workers, such as types of equipment, products and
services, types of customers. It is outlined in the competency standards.
Candidates will be assessed on their competency in CU4 Plan a Training Needs Analysis in
accordance with the following specifications:
Written Assignment
Q 1 (1-2 pages)
Prepare a Trekkers TNA project plan that outlines what will happen in the TNA. Use preliminary
information provided by Tracey (the client). Include
Q 2 (1500 words)
Write a Training Needs Analysis report for Trekkers stakeholders using the data, discussions
and findings from the Trekkers case study. Your report must include
Q3
During the TNA process at Trekkers, one of the team leaders guesses the name of a team
member who made negative comments in a confidential interview. The team leader plans to
correct the persons misperceptions.
A Explain whether this is an ethical issue. If so, how will you deal with this issue?
B Describe two ethical principles and relevant professional standards that will inform
your decisions and actions?
Written Assessment
The candidate will complete a written test. This is an open-book assessment. Candidates will be
required to answer questions about
responding to a client request for training
reporting data using basic descriptive statistics
trends in needs analysis
.....end....