Professional Documents
Culture Documents
Tanushree Gulati
Presentation Methods
• Seminars
• Workshops
• Group Discussion
• Syndicates
Case Studies
Tanushree Gulati
Key elements in SBE
• Simulation based Education (SBE) has
four key elements –
Tanushree Gulati
Role of the Trainer in SBE
• Not all experiences
are equally • To help the students
educative (Dewey) – differentiate between
Tanushree Gulati
Evaluation of Training
Introduction
• Training effectiveness refers to the
benefits that the company and the trainees
receive from training
Purpose
• Improve service for customers/trainees
• Fulfill legal requirements
• Building awareness or advocating
Principles of Evaluation
• Management needs to know status
• Third-party conformance testing
Throughness
• Preliminary - quick check to catch major issues
• Conformance - thorough check to determine
conformance
• Comprehensive - involves testing with users as well
Principles of Evaluation
Ready to go...
• Determined purpose
• Determined selection
• Determined thoroughness
Principles of Evaluation
Evaluation vs. Validation
• There's no magic, evaluation tools need
humans:
• tools can help detect barriers,
• tools can help determine barriers,
• tools can help repair barriers,
• tools need human judgement.
Principles of Evaluation
Usages of evaluation tools
• Generating reports
• Step-by-step evaluations
• In-page feedback
• Page transformations
• Some tools provide different modes for checking.
Selecting tools
• User interface
• Checkpoint coverage
• Integration
• Web technology support
• Output formats
The Evaluation Process-Criteria
and Approaches
Conduct a Needs
Analysis
Develop Measurable
Learning Outcomes and
Analyze Transfer of Training
Develop Outcome
Measures
Choose an Evaluation
Strategy
Cognitive Skill-Based
Outcomes Outcomes
Return on
Affective Results Investment
Outcomes
Outcomes Used in Evaluating
Training Programs
• Cognitive Outcomes
–Determine the degree to which trainees are familiar
with the principles, facts, techniques, procedures,
or processes emphasized in the training program
–Measure what knowledge trainees learned in the
program
• Skill-Based Outcomes
–Assess the level of technical or motor skills
–Include acquisition or learning of skills and use of
skills on the job
Outcomes Used in Evaluating
Training Programs
• Affective Outcomes
– Include attitudes and motivation
– Trainees’ perceptions of the program including
the facilities, trainers, and content
• Results
– Determine the training program’s payoff for the
company
Outcomes Used in Evaluating
Training Programs
• Return on Investment (ROI)
– Comparing the training’s monetary benefits
with the cost of the training
• direct costs
• indirect costs
• benefits
How do you know if your outcomes
are good?
Good training outcomes need to be:
• Relevant
• Reliable
• Discriminative
• Practical
Good Outcomes: Relevance
• Criteria relevance – the extent to which training
programs are related to learned capabilities
emphasized in the training program
• Criterion contamination – extent that training
outcomes measure inappropriate capabilities or are
affected by extraneous conditions
• Criterion deficiency – failure to measure training
outcomes that were emphasized in the training
objectives
Good Outcomes (continued)
• Reliability – degree to which outcomes can
be measured consistently over time
• Discrimination – degree to which trainee’s
performances on the outcome actually reflect
true differences in performance
• Practicality – refers to the ease with which
the outcomes measures can be collected
Training Evaluation Practices
80% 79%
Percentage of Courses Using
70%
60%
50%
40% 38%
Outcome
30%
20% 15% 9%
10%
0%
Reaction Cognitive Behavior Results
Outcomes
Training Program Objectives and
Their Implications for Evaluation:
Objectiv
e
Learnin Transfer
g
Outcom
es
Reactions: Did trainees like the Skill- Ratings by peers or
program? Based: managers based on
Did the environment help observation of behavior
learning?
Was material meaningful?
Cognitive: Pencil-and-paper tests Affective: Trainees’ motivation or job
attitudes
Skill- Performance on a work Results: Did company benefit
Based: sample through sales, quality,
productivity, reduced
accidents, and complaints?
Performance on work
Factors That Influence the Type of
Evaluation Design
Factor How Factor Influences Type of Evaluation
Design
Change Can program be modified?
potential
Importance Does ineffective training affect customer
service, product development, or relationships
between employees?
Scale How many trainees are involved?
Purpose of Is training conducted for learning, results, or
training both?
Organization Is demonstrating results part of company
culture norms and expectations?
Expertise Can a complex study be analyzed?
Cost Is evaluation too expensive?
Time frame When do we need the information?
To calculate return on investment
(ROI), follow these steps
1. Identify outcome(s) (e.g., quality, accidents)
2. Place a value on the outcome(s)
3. Determine the change in performance after
eliminating other potential influences on
training results.
4. Obtain an annual amount of benefits
(operational results) from training by
comparing results after training to results
before training (in dollars)
To calculate return on investment
(ROI), follow these steps
5. Determine training costs (direct costs + indirect
costs + development costs + overhead costs +
compensation for trainees)
6. Calculate the total savings by subtracting the
training costs from benefits (operational results)
7. Calculate the ROI by dividing benefits (operational
results) by costs
The ROI gives you an estimate of the dollar return
expected from each dollar invested in training.
Determining Costs for a Cost-
Benefit Analysis:
Compensation
Development Overhead for
Costs Costs Trainees
Goldstein Systematic Training Model
Develop
Needs Assessment
Criteria
Select and Design
Derive Objectives Instructional Pretest
Programs Trainees
Conduct Monitor
Training Training
Evaluation not only takes place after learning, but before, during,
and after instruction. It is a continuous flow of information, Evaluate
occurring from the initial steps through return to on-the-job Training
activity. Constantly collecting data enables designers and
instructors to update and perfect their curriculum, materials,
equipment, and methods and set the stage for the next employee Evaluate
training program. Transfer
Process of Calculating ROI in
Training
• Trainers have struggled for years with the
concept of how to demonstrate return on
investment (ROI) from training.
• Because of the many variables involved, it
is often very difficult to tie business results
directly to training outcomes.
• But training ROI can be measured
Process of Calculating ROI in
Training
Process of Calculating ROI in
Training
• Select the right program.
• Choose a program for ROI analysis that is
important in helping the organization meet its
goals.
• Select the program based on its cost, its
visibility, the size of the target audience and
the extent of management interest.
• This is important in justifying the time and
cost of performing the ROI analysis.
Process of Calculating ROI in
Training
• Collect data. Identify appropriate performance indicators
and develop a data collection plan.
• Select output data such as units produced, units sold,
work backlog, new accounts opened, inventory turnover
or productivity.
• Alternately, collect time data such as equipment
downtime, overtime, time to project completion,
processing time, lost time delays or repair time.
• Measure hard costs, such as cost per unit, variable
costs, operating costs and overhead.
• Also measure quality indicators, such as scrap, waste,
rejects, error rates, product failures and rework.
Process of Calculating ROI in
Training
• Isolate the effects of training.
• Use a control group, trend line analysis
(comparison of projected rate versus rate
after training), participants' estimates or
managers' estimates to determine the
impact of training.
Process of Calculating ROI in
Training
• Convert data to monetary values.
• Focus on a unit of improvement (hours of equipment
downtime, for example).
• Determine the value of each unit (the cost per hour for
equipment downtime).
• Calculate the change in performance after training.
• Determine an annualized amount of change.
• Calculate the annual value of improvement.
• This is the net program benefit.
Process of Calculating ROI in
Training
• Tabulate the cost of the training program.
• Include costs for design and development,
program materials, facilitator fees, facilities
and administrative and overhead costs.
• Also include participant costs: travel,
lodging, meals and salaries and benefits
for the period of time they were in training.
Process of Calculating ROI in
Training
• Calculate ROI.
• Divide the net program benefit by program
costs and multiply by 100.
• This calculation will provide a percentage of
return on the training investment.
• An ROI of more than 100 percent indicates
that the benefit of training was more than the
cost.
Process of Calculating ROI in
Training
• Determine intangible benefits of training.
• These are soft benefits that cannot be directly
measured or included in the ROI calculation.
• Nonetheless they are important.
• Examples include improvement in morale,
market perception or employee engagement.
The
Emerging
Issue
Cost-effectiveness of training
must be addressed. Companies
should:
Assess their own needs
Develop programs that are
understood by their
employees
Evaluate training to determine
that objectives have been
achieved
Emerging Trends in Training and
Development
Multimedia and Online Training
Web Based Training (WBT)
Electronic Performance Support Systems (EPSS) that
deals with the interface between people and software.
Performance Consulting
• providing a range of potential solutions and assists that
include in-depth needs assessment via interviews,
surveys and focus groups.
• Alternatives to training offered by progressive human
resource departments include coaching, organizational
development or planned change consultation and
interventions, facilitated planning sessions and large
group processes.
Emerging Trends in Training
and Development
• The training that is provided is often custom-designed with
stated outcomes congruent with the direction of the
business.
Performance Management
• Integration of training and development into an entire
performance management system. Organizations are
moving away from the long-established, one-on-one
appraisal or performance review with a boss held once per
year.
• They are designing performance management systems,
instead, that provide an individual with personal and
professional developmental goals and training
opportunities. In a performance management system,
people receive more frequent feedback from many points
of view including peers, direct reporting staff members and
the boss.
Emerging Trends in Training
and Development
• Performance development plans may include
coursework, but also provide learning activities on the
job such as special projects, serving on cross-functional
teams, and skill stretching job assignments.
Conclusions About Training Trends
• Traditional classroom training is no longer the exclusive
opportunity to learn.
• The age of training that includes training CDs, email
classes, online learning, blended learning and university
degrees online is exploding.
New Perspectives on Training
Future Trends in
Training and
Development
Practices
Job
requirements
will demand
more than basic
skills.
New Perspectives on Training
Future Trends in
Training and
Development
Practices
More emphasis
will be placed
on increasing
skills of
managers
New Perspectives on Training
Future Trends in
Training and
Development
Practices
The number of
team-based and
empowered
organizations
will increase
New Perspectives on Training
Future Trends in
Training and
Development
Practices
Organizations
will require
more training to
develop training
programs
Cross-cultural Training
There are more than 160 definitions of culture
H. Law
• Common Law
• Code Law
• Foreign law
• Home / Host Country Law
• Regulation / Antitrust Policy
• International Law
Cultural Factors
• Never touch the head of a Thai or pass an object over it.
The head is considered sacred in Thailand
• Avoid using triangular shapes in Hong Kong, Korea and
Taiwan. It is considered a negative shape.
• The number 7 is considered bad luck in Kenya, good luck in
Czech Republic and has magical connotation in Benin, Africa
• The number 10 is bad luck in Korea
• The number 4 is means Death in Japan
• Red represents witchcraft and death in many African countries
Cultural Difference between Japanese and American Individual
lifestyles
Low mutual dependence between employers High mutual dependence between employers and
and employees employees
Control of business by stockholders and the Joint management of business by Employees and
management Employees