You are on page 1of 7

An Argument for Clarity:

What are Learning Management


Systems, What are They Not, and
What Should They Become?
By William R. Watson and Sunnie Lee Watson

The application of computers to education respectively (Parr & Fung, 2001). LMS has its
has a history dating back to the 1950s, well history in another term, integrated learning
before the pervasive spread of personal system (ILS) which offers functionality beyond
computers (Reiser, 1987). With a mature instructional content such as management
history and varying approaches to utilizing and tracking, personalized instruction and
computers for education, a veritable alphabet integration across the system (Bailey, 1993;
soup of terms and acronyms Becker, 1993; Brush, Armstrong, Barbrow, &
“A veritable related to computers in Ulintz, 1999; Szabo & Flesher, 2002).
education have found their way The term ILS was coined by Jostens Learn-
alphabet soup into the literature, most of them ing, and LMS was originally used to describe the
non-standardized. Learning management system component of the PLATO
of terms and Management System (LMS) is K-12 learning system, content-free and separate
acronyms related one approach to the application from the courseware (R. Foshay, personal com-
of computers to education munication, October 24, 2006). The term LMS
to computers which holds great potential is currently used to describe a number of differ-
and important concepts yet is ent educational computer applications, and we
have found often misunderstood and the would argue that it is often used incorrectly. Lat-
term misused. This article will er sections of this article will differentiate LMS
their way into clarify the use of the term LMS from other terms with which it is often confused,
the literature.” by presenting a history and but prior to describing what LMS is not; we will
definition of LMS, differentiating focus on describing what an LMS is.
it from similar terms with which it is often The key to understanding the difference
confused, and discussing the role it can play between LMS and other computer education
in education. It will then describe current terms is to understand the systemic nature of
application and available features of LMSs, LMS. LMS is the framework that handles all
and conclude by identifying trends and aspects of the learning process. An LMS is the
recommending future research. infrastructure that delivers and manages in-
structional content, identifies and assesses in-
History and definition of LMS: dividual and organizational learning or training
goals, tracks the progress towards meeting those
What are LMSs? goals, and collects and presents data for super-
The history of the application of computers vising the learning process of an organization as
to education is filled with generic terms such as a whole (Szabo & Flesher, 2002). An LMS deliv-
computer-based instruction (CBI), computer- ers content but also handles course registration
assisted instruction (CAI), and computer- and administration, skills gap analysis, tracking
assisted learning (CAL), generally describing and reporting (Gilhooly, 2001).
drill-and-practice programs, more sophisticated Bailey (1993) presents the following general
tutorials and more individualized instruction, characteristics of an LMS in education:

28 TechTrends • March/April 2007 Volume 51, Number 2


v Instructional objectives are tied to indi- Relating LMS to CMS, LCMS and
vidual lessons.
v Lessons are incorporated into the
RLO: What are LMSs not?
standardized curriculum. As the application of computers to
v Courseware extends several grade levels education is awash with acronym-driven, non-
in a consistent manner. standardized terms, it is not surprising that
v A management system collects the results there is often confusion as to which term is
of student performance. appropriate to use. A major goal of this article
v Lessons are provided based on the is to recommend a consistent use of the term
individual student’s learning progress. LMS in the literature. In order to do this, it
is important to identify
The American Society for Training &
some of the ways in which
Development (Learning Circuits, 2005),
recommends these following functional
we believe LMS is being “The term LMS
inappropriately used to
requirements for a corporate LMS:
v enable integration with the human
describe separate but is currently
related technologies.
resources system used to describe
v incorporate tools which enable the Course Management
administration to: Systems a number of
v manage user registrations and develop The inappropriate use
user profiles of LMS in the literature is
different computer
v set curricula and certification paths
v assign tutors and tutorial content
perhaps most commonly
associated with computer
applications.”
v administer budgets applications which we
v prepare schedules for learners, would identify as Course Management Sys-
instructors and classrooms tems (CMS). These systems are used primarily
v provide access to content delivery for online or blended learning, supporting the
involving the medium (classroom, placement of course materials online, associ-
online), method (instructor-led, self- ating students with courses, tracking student
paced), and learners (employees, performance, storing student submissions and
customers) mediating communication between the stu-
v develop content, including authoring, dents as well as their instructor. Some of this
maintaining and storing same functionality can be seen within LMSs
v integrate content with third-party as well, so it is understandable why confusion
courseware might exist. However, the systemic nature of an
v assess learners’ competency gaps and LMS does not limit its functionality to that of
manage skills acquisition and status a CMS.
v provide and support authoring of A CMS “provides an instructor with a
assessments set of tools and a framework that allows the
v adhere to standards such as SCORM and relatively easy creation of online course content
AICC which allow for importing content and the subsequent teaching and management
and courseware that complies with of that course including various interactions
standards regardless of the authoring with students taking the course” (EDUCAUSE
system Evolving Technologies Committee, 2003, p.
v support configuration of the LMS to 1). Examples of a CMS include Blackboard,
function with existing systems and Angel, Sakai, Oncourse and Moogle. However,
internal processes Blackboard is a good example of the confusion
v provide security such as passwords and that exists regarding these terms as it is
encryption commonly referred to in the literature as an
While this list of features can be helpful in LMS.
understanding what an LMS is, as a systemic A Google Scholar search of the phrase
application, it incorporates a great many features “blackboard lms” returned 36 articles identi-
by providing the structure of the entire learning fying Blackboard as an LMS, while the Black-
process within an organization. Therefore, board company itself refers to its product as a
further clarity can be achieved by contrasting it CMS: “Blackboard’s online learning applica-
with related technologies with which it is often tion, the Blackboard Learning System, is the
confused. most widely-adopted course management sys-
tem [emphasis added] among U.S. postsecond-

Volume 51, Number 2 TechTrends • March/April 2007 29


ary institutions” (Blackboard Company, 2006b). Learning objects and integrating
While Blackboard’s Learning System does not
comprise their entire Academic Suite, the ad- these related technologies
ditional products support better management Having described the complementary na-
of learning objects, student portfolios, and the ture of LCMSs and LMS as well as the different
creation of online portals, focus of CMS and LMS, and understanding the
which collectively Black- systemic nature of LMS as providing the struc-
“LMS is the board calls a Networked ture within which CMS and LCMS can function,
we will now examine an important technology,
Learning Environment
framework that (Blackboard Company, learning objects, which is not typically confused
2006a), does not meet the with LMS but which is inherently important to
handles all aspects full functionality necessary the integration of these related technologies. A
LO represents the smallest component of con-
of the learning to be identified as an LMS.
The scope of functional- tent within an LCMS or LMS. LOs offer power-
process.” ities does not encompass ful potential due to their promise of reusability
across multiple contexts, generativity (integrat-
the entire organization,
and the course-focused na- ing LOs to generate new instruction), adaptabil-
ture of the applications is not systemic. There- ity to meet the needs of individual learners and
fore, while a CMS could be seen as a part of an scalability to meet the needs of both larger and
LMS, it is certainly not equivalent to an LMS. smaller audiences without significant changes
The technologies were developed for very dif- in cost (Gibbons, Nelson, & Richards, 2002;
ferent reasons even if they share certain func- Hodgins, 2002; Wiley, 2002).
tionalities (Carliner, 2005). Essentially, a learning object can be defined
as any digital media that can be reused to support
Learning Content Management learning (Watson, Lee, & Reigeluth, 2007). It
Systems is the reusable nature of the LO which holds
the most promise and challenges for success.
While also being frequently confused with In order to maximize LOs reusability, it must
each other, Learning Content Management adhere to standards, such as SCORM or LOM,
Systems (LCMS) and LMSs can be more which utilize metadata to describe the object
simply contrasted as they are very well suited as well as the context for its use. Unfortunately,
to integration with each other. LCMS is often there are multiple standards for describing
used interchangeably with LMS or touted as LOs in use as well as multiple standards “for
a newer version of LMS. In reality, the two evaluating interoperability between LMSs and
applications focus on different functions and content” (Connolly, 2001, p. 57).
complement each other well. The key difference The lack of agreement and adherence to
between the two technologies is as simple as standards with both the creation of LOs and their
the one word separating them: content. Oakes inclusion in LMSs results in a negative impact on
(2002) reports that the IDC defines an LCMS reusability, flexibility and functionality. Ideally,
as a system used to “create, store, assemble LOs, CMS, and LCMS would be integrated
and deliver personalized e-learning content together within the LMS which would act as
in the form of learning objects” (p. 73). The the infrastructure to seamlessly bring together
focus with LCMS is content as “it tackles the these complementary technologies. LOs would
challenges of creating, reusing, managing, and act as the smallest form of content handled by
delivering content” (Oakes, 2002, p. 74). An the LMS, created and delivered within an LCMS
LMS, however, is “learner and organization according to each individual learner’s need based
focused: It’s concerned with the logistics of on current assessments and performance toward
managing learners, learning activities and customized learning goals. The CMS would
the competency mapping of an organization” function as a course environment, organizing
(Oakes, 2002, p. 74). instructional content into discrete courses and
LCMS and LMS certainly have a different supporting communication between learners
focus but integrate very well; the LCMS allows and instructors.
for the creation and delivery of learning objects
(LO) while LMS manages the learning process Role of LMS in education: What
as a whole, incorporating the LCMS within
it (Greenberg, 2002). Or as Connolly (2001) should LMSs become?
puts it, “LMS provides the rules and the LCMS The importance of understanding LMS as
provides the content” (p. 58). well as its related technologies lies in the role it

30 TechTrends • March/April 2007 Volume 51, Number 2


will play in future approaches to instruction as can currently perform some of these functions,
the needs of today’s learners are not being met limitations exist which are hindering the full
by current approaches. Society has shifted from realization of LMSs’ potential.
the Industrial Age into what many are calling We have previously discussed the challenges
the Information Age (Reigeluth, 1994; Senge, presented by lack of agreement and adherence
Cambron-McCade, Lucas, Smith, Dutton, & regarding standards that result in a negative
Kleiner, 2000; Toffler, 1984). Today’s education impact on the reusability
system remains mired in the Industrial Age, put-
ting the onus for learning on teachers, encour-
of learning objects and the
effectiveness and efficiency
“It is not surprising
aging students to remain passive, and treating of LMSs. LOs are difficult that there is often
all students as if they are the same and forcing enough to create but the
them to do the same things in the same amount challenge of then applying confusion as to
of time (Reigeluth, 1994). This forces achieve- standards which will result
ment to vary among the students, leaving the in easy implementation which term is
low-achieving students behind and holding
the higher-achieving students back (Reigeluth,
within an LCMS or LMS
are an additional headache
appropriate to use.”
1997). The alternative to holding time constant for instructional designers.
and forcing learning to occur at a single rate is Without effective use of standards, even an LO
to hold achievement at a constant mastery level. well suited to broad reuse is unlikely to be re-
This requires education to shift to an entirely used due to the lack of awareness regarding its
new paradigm, from one with a focus on stan- availability. Some work is currently being done
dardization and sorting with a high rate of fail- on Automatic Metadata Generation (AMG) in
ure to one that supports customization to meet order to ease the load on designers to have to tie
all learners’ needs. their instruction to standards themselves (Au-
In an Information Age-appropriate para- tomatic Metadata Generation, 2006).
digm of education, students will be allowed The challenges of creating effective LOs
as much time as they need to achieve mastery needs to be addressed with better authoring
and move on immediately upon demonstrating tools allowing for the creation of effective in-
that mastery, requiring a customized pace and struction suitable for specific types of learners.
sequencing of instruction (Schlechty, 1991). In- Many of the current K-12 LMS platforms uti-
struction will move to a more learner-centered lize older instruction which has been minimally
approach as teachers cease acting primarily as updated if at all. The reason is the immense cost
knowledge sources and instead become facili- in developing the instruction, estimated as high
tators of the knowledge acquisition process by as $100 million to build a comparative system
acting as guides, coaches, and motivators as stu- today (R. Foshay, personal communication,
dents become more active in their learning pro- October 24, 2006). By incorporating authoring
cess (McCombs & Whisler, 1997). tools to allow for easier creation of learning ob-
In order for the learner process to be cus- jects by practitioners, some of these challenges
tomized for each individual learner, technology can be overcome.
will need to play a key role. Schlechty (1991) The increasing availability of open-source
argues that technology will be needed to track technologies is another potential advantage,
each student’s progress towards mastery, assess dispersing the resource load for creating, updat-
their learning, help teachers understand what ing, and maintaining these technologies across a
sort of guidance is needed, provide and appro- global community of developers rather than one
priately sequence instruction, store evidence of or two private companies. Ultimately, LMSs need
attainments and systemically integrate each of to
these functions. It is clear that this description is vprovide more constructivist-based instruc-
closely aligned to the functions of an LMS. tion, focusing on flexible, learner-defined
In an Information Age model of education, goals (Reigeluth & Garfinkle, 1994)
an LMS will assess learners’ current knowledge vsupport collaborative learning inside and
and skill level, work with teachers and learners outside of the school in order to extend the
to identify appropriate learning goals, identify learning environment to the home and fur-
and sequence instruction appropriate for the ther involve parents (Taylor, 2004)
individual learner, assess learner performance vbetter address personalized assessment,
products, store evidence of attainments, sup- progress tracking, reporting, and respon-
port collaboration and generate reports to pro- siveness to learner needs (Reigeluth & Gar-
vide information to maximize the effectiveness finkle, 1994)
of the entire learning organization. While LMSs

Volume 51, Number 2 TechTrends • March/April 2007 31


vtruly become systemic, integrating systems well these products function together, so it is
seamlessly to allow for improved collabora- possible that not all features listed will function
tion across systems and among stakeholders together as a complete package. Furthermore,
(Sherry, 1992) some of the features are more of a matter of
vimprove support for professional diagnosis degree rather than a simple yes or no.
and development for stakeholders, includ- We have updated the table as Pearson Digital
ing teachers Learning recently purchased Co-nect, and we
vimprove cost effectiveness and better leverage made a small change in wording regarding the
existing resources currently available in direct instruction feature to better reflect our
schools and LMSs (Szabo & Flesher, 2002) original intentions of the meaning of the word
While serious challenges are currently in the LMS context. Within the list of features,
impeding LMSs from realizing their full the table shades features that are important
potential, perhaps the greatest possibility for for instruction within the Information Age
improving these technologies lies in the hands paradigm.
of learners, teachers, and other stakeholders in
the current educational system. That is, once Conclusion
they demand a shift to an Information Age LMSs are a powerful technology that have
paradigm of instruction, the full and centralized yet to reach their full potential and are impor-
implementation of LMSs will be necessary, and tant for the Information Age paradigm of edu-
the attention to maximizing their potential will cation. Because of their importance, greater
naturally be realized. care and under-
Overview of major LMS: What do standing needs to
current LMSs offer?
be used when ap- “We will need
plying the term in
This final section will present an overview research literature. to conduct
of the status of several major LMSs available By coming to an
today. LMSs are more typically utilized in understanding of research to
corporate settings with many available systems what LMSs are and
how complementa-
help guide
on the market, including NetDimensions EKP,
Saba and SumTotal Systems (Carliner, 2005), ry technologies can decisions
as well as Lotus, Oracle be integrated with
iLearning and Cornerstone an LMS, research- and future
“Perhaps the OnDemand, among others ers and practitio-
applications
greatest possibility (Learning Circuits, 2005). ners will better be
A 2006 survey highlights able to communi- of technology.”
for improving these the features most common- cate regarding the
ly found in the corporate state and future of
technologies lies in LMSs currently being computers in education. However, understand-
utilized (2006 Survey of ing and consistent use of terms alone is not suf-
the hands of learners, Learning Management ficient for the potential of computer technolo-
teachers, and other Systems, 2006). gies in education to be realized. There is a real
dearth of solid research on LMSs.
In the K-12 market,
stakeholders.” two major systems have Studies about the implementation and ef-
been absorbing the fectiveness of the LMS products discussed in
smaller products over the last several years. this article are needed. These studies should
The following table reflects a summary of the examine more closely what features these prod-
previous research we have conducted in which ucts offer and identify the additional features
we generated a conceptual framework of major that are needed. Student, teacher, parent and
features in order to evaluate and compare the other stakeholder perceptions of these products
major K-12 LMSs (Watson, Lee, & Reigeluth, as well as the individual features should be de-
2007). We reviewed corporate literature to scribed. Furthermore, more research is needed
identify which features each LMS offered, in the area of learning object authoring and ad-
and with the exception of PLATO, whose herence to standards.
representatives declined comment, had each With the constant adoption and discard-
company review and approve our conclusions. ing of terms in the fast-paced world of comput-
It should be stated that while the table represents ers, communication can be hindered, concepts
our conclusions, the LMSs are composed blurred and research stunted. It is important to
of multiple products, and it is unclear how keep an eye on the needs of today’s learners and

32 TechTrends • March/April 2007 Volume 51, Number 2


Pearson
Features Achievement
PLATO Digital
(grayed features support information-age needs) Technologies
Learning
Content presentation ¥ ¥ ¥
Curriculum standards ¥ ¥ ¥
Supporting teacher-directed
¥
instruction
Standard Bilingual ¥ ¥ ¥
features Self-paced learning ¥ ¥ ¥
Project-based work ¥
Group work ¥
Authentic, real-world problems ¥ ¥
Individualized instruction ¥ ¥ ¥
Adaptive sequencing ¥ ¥ ¥
Instructional Teacher Adaptive lesson plans ¥ ¥
Method customiz- Customizable instructional
ability ¥ ¥
content
Prescription of lessons ¥ ¥ ¥
Online message center ¥
Online discussion board ¥
Project-based work ¥
Outside Activities/homework with
¥ ¥ ¥
school parent involvement
Community relations and
¥ ¥
support
Online lesson plan
¥
management for teachers
Attendance ¥
Health information ¥
Parent/guardian information ¥
Data management Enrollment ¥
Class schedule ¥
Record of attainments
¥ ¥ ¥
mastered
Mastery progress ¥ ¥ ¥
Post test / Pre test ¥ ¥ ¥
Formative tests ¥
Assessment Practice tests ¥ ¥
Diagnostic tests ¥ ¥ ¥
Mastery-level tests ¥ ¥ ¥
Summative test report to
¥ ¥ ¥
teachers/ parents
Formative test report to
¥ ¥ ¥
teachers/ parents
Student information report to
¥
Reporting teachers/ parents
Record of attainments report to
¥ ¥ ¥
teachers/ parents
Mastery progress report to
¥ ¥ ¥
teachers/ parents
Customizable reporting for
¥
teachers
Table 1: Comparison of major features of K-12 LMS products

Volume 51, Number 2 TechTrends • March/April 2007 33


how technology can be maximized to Educational Computing Research, 21(4), Reigeluth, C. M. (1994). The imperative for sys-
best meet those needs and to conduct 475-486. temic change. In C. M. Reigeluth & R. J.
research to help guide decisions and Carliner, S. (2005). Course management sys- Garfinkle (Eds.), Systemic change in edu-
future applications of technology. tems versus learning management sys- cation (pp. 3-11). Englewood Cliffs, NJ:
tems. Learning Circuits. Retrieved No- Educational Technology Publications.
vember 20, 2006, from http://www.learn- Reigeluth, C. M. (1997). Educational standards:
William R. Watson is a lecturer in Com-
ingcircuits.org/2005/nov2005/carliner. To standardize or to customize learning?
puter and Information Technology, Purdue htm Phi Delta Kappan, 79(3), 202-206.
School of Engineering Technology, Indiana Uni- Connolly, P. J. (2001). A standard for success. Reigeluth, C. M., & Garfinkle, R. J. (1994). En-
versity - Purdue University Indianapolis and a InfoWorld, 23(42), 57-58. visioning a new system of education. In
doctoral student in the Instructional Systems EDUCAUSE Evolving Technologies Commit- C. M. Reigeluth & R. J. Garfinkle (Eds.),
Technology Department at Indiana University, tee. (2003). Course Management Systems Systemic change in education (pp. 59-70).
Bloomington. His research interest focuses on (CMS). Retrieved November 20, 2006, Englewood Cliffs, NJ: Educational Tech-
advanced technologies for Information Age in- from http://www.educause.edu/ir/library/ nology Publications.
struction, including the design of instructional pdf/DEC0302.pdf Reiser, R. A. (1987). Instructional technol-
video games and Learning Management Sys- Gibbons, A. S., Nelson, J. M., & Richards, R. ogy: A history. In R. M. Gagne (Ed.),
(2002). The nature and origin of instruc- Instructional technology: Foundations (pp.
tems. He may be reached at wwatson@iupui.
tional objects. In D. A. Wiley (Ed.), The 11-48). Hillsdale, NJ: Lawrence Erlbaum
edu.
instructional use of learning objects: Online Associates.
Sunnie Lee Watson is an associate instruc- version. Retrieved November 20, 2006, Schlechty, P. C. (1991). Schools for the 21st cen-
tor and doctoral student in the Instructional from http://reusability.org/read/chapters/ tury: Leadership imperatives for educa-
Systems Technology Department at Indiana gibbons.doc tional reform. San Francisco: Jossey-Bass
University, Bloomington. Her research focus Gilhooly, K. (2001). Making e-learning effec- Inc.
lies in the learner-centered paradigm of instruc- tive. Computerworld, 35(29), 52-53. Senge, P., Cambron-McCabe, N., Lucas, T.,
tion, technology integration in K-12 classrooms, Greenberg, L. (2002). LMS and LCMS: What’s Smith, B., Dutton, J., & Kleiner, A. (2000).
and systemic change in education. She may be the Difference?. Retrieved November 20, Schools that learn: A fifth discipline field-
reached at suklee@indiana.edu. 2006, from http://www.learningcircuits. book for educators, parents, and everyone
org/2002/dec2002/greenberg.htm. who cares about education. Toronto, Can-
Hodgins, H. W. (2002). The future of learn- ada: Currency.
References ing objects. In D. A. Wiley (Ed.), The in- Sherry, M. (1992). Integrated learning systems:
Automatic Metadata Generation. (2006). structional use of learning objects: Online What may we expect in the future? Edu-
Introduction: Why we need AMG, version. Retrieved November 20, 2006, cational Technology, 32(9), 58-59.
first version, and redesign. Retrieved from http://reusability.org/read/chapters/ Szabo, M., & Flesher, K. (2002). CMI theory
November 20, 2006, from http://ariadne. hodgins.doc and practice: Historical roots of learning
cs.kuleuven.be/amg/Intro.jsp Learning Circuits. (2005). A field guide to management systems. Paper presented at
Bailey, G. D. (1993). Wanted: A road map learning management systems. Re- the E-Learn 2002 World Conference on
for understanding Integrated Learning trieved November 12, 2006, from http:// E-Learning in Corporate, Government,
Systems. In G. D. Bailey (Ed.), Computer- www.learningcircuits.org/NR/rdon- Healthcare, & Higher Education, Mon-
based Integrated Learning Systems (pp. lyres/BFEC9F41-66C2-42EF-BE9D- treal, Canada.
3-9). Englewood Cliffs, NJ: Educational E4FA0D3CE1CE/7304/LMS_fieldguide1. Taylor, F. P. (2004). Education technology
Technology Publications. pdf helps unite school communities, improve
Becker, H. J. (1993). A model for improving Learning Circuits. (2006). 2006 Survey of academic achievement. T.H.E. Journal,
the performance of Integrated Learning Learning management systems. Re- 31(10), 46-48.
Systems. In G. D. Bailey (Ed.), Computer- trieved November 20, 2006, from http:// Toffler, A. (1984). The third wave. New York:
based Integrated Learning Systems (pp. www.learningcircuits.org/2006/August/ Bantam.
11-31). Englewood Cliffs, NJ: Educational 2006LMSresults.htm Watson, W. R., Lee, S., & Reigeluth, C. M.
Technology Publications. McCombs, B., & Whisler, J. (1997). The learner- (2007). Learning management systems:
Blackboard Company. (2006a). Blackboard centered classroom and school. San Fran- An overview and roadmap of the system-
Academic Suite brochure. Retrieved cisco: Jossey-Bass. ic application of computers to education.
November 14, 2006, from http://library. Oakes, K. (2002). E-learning: LCMS, LMS— In F. M. M. Neto & F. V. Brasileiro (Eds.),
blackboard.com/docs/as/bb_academic_ They’re not just acronyms but powerful Advances in computer-supported learning
suite_brochure_single.pdf systems for learning. Training & Develop- (pp. 66-96). London: Information Science
Blackboard Company. (2006b). Evaluating ment, 56(3), 73-75. Publishing.
education. Retrieved November 21, Parr, J. M., & Fung, I. (2006). A review of the Wiley, D. (2002). Connecting learning objects
2006, from http://www.blackboard.com/ literature on computer-assisted learning, to instructional design theory: A defini-
company/ particularly Integrated Learning Systems, tion, a metaphor, and a taxonomy. In D.
Brush, T. A., Armstrong, J., Barbrow, D., & and outcomes with respect to literacy and A. Wiley (Ed.), The instructional use of
Ulintz, L. (1999). Design and delivery of numeracy. Retrieved November 20, 2006, learning objects: Online version. Retrieved
Integrated Learning Systems: Their impact from http://www.minedu.govt.nz/index. November 20, 2006, from http://reusabil-
on students achievement and attitudes. cfm?layout=document&documentid=5 ity.org/read/chapters/wiley.doc
499&indexid=6920&indexparentid=1024

34 TechTrends • March/April 2007 Volume 51, Number 2

You might also like