Professional Documents
Culture Documents
Reliability,
and Region
Customer satisfaction and electric utilities.
Defining Satisfaction
Customers might at current and projected
Customer satisfaction largely depends on whether a companys rates, as well as other
products or services fulfill a customers expectationsi.e., whether forgive their utility if customer issues when
it meets, exceeds, or falls short. Quantifying customer satisfaction rates go up, as long rating investments in
involves accumulating specific customer perceptions, measured as they perceive electric utilities.
through surveystypically using a 5- or 10-point scale, ranging Currently, the threat
from extremely dissatisfied to extremely satisfiedthat are service is improving of losing customers due
presented at various levels of aggregation.1 or at least to increased competition
Its fairly common practice for companies to survey custom- consistently reliable. and potential bypass of
ers in order to understand how customers perceive the service the electric distribution
they receive; its even more widespread in recent years with the system through distrib-
evolution of Internet and app-based survey instruments. Surveys uted generation is driving electric utilities interest in customer
frequently pay significant attention to non-price dimensions, satisfaction. Investment in utility infrastructure is projected
especially in price-competitive environmentssuch as airlines to increase as growth in sales is declining; at the same time,
and retail bankingas companies look for ways to differentiate alternatives to the electric grid are becoming more widespread
themselves against competitors. and cost competitive. Also, the rates for delivering electric power
Historically, electric utilities havent been directly subject are almost always volume-based, which means that defections
to price competition for electric products due to geographic of customers can have a large impact on unit rates. As a result,
franchise arrangementsalthough cross-fuel competition in attracting and retaining customers to keep prices affordable is
many areas could be quite fierce. It could be argued that, with more important than ever.
nowhere else to turn, customers had few alternatives to their local Another development that has brought utility customer
utility, thereby reducing the importance to utility management of satisfaction to the forefront is the use of benchmarking studies,
satisfied customers. However, even the most short-sighted utility which compare levels of customer satisfaction across utilities.
managers recognized that satisfying customers was important and High scores in benchmarking studies can show that utilities are
that it needed to be included as an element of business strategy. recognized by their customers as being the best in class. This
For one reason, state regulatory commissions typically required notion of comparing levels of customer satisfaction across utilities
utilities under their jurisdiction to conduct customer satisfac- can be perplexing to many utility managers. Utilities typically
tion surveyswhich were taken into account in rate and other serve all of the retail customers in a defined geographic area
proceedings. For another, bond and equity analysts also looked on an exclusive basis; some residentialas well as small com-
mercialcustomers reside in the same utility service area for all
1. The most common scales used to measure customer satisfaction are classical of their lives. This means that customers arent necessarily in a
Likert scales, which describe the range of possible attitudes from very
position to directly compare their utilitys performance against
dissatisfied to very satisfied using numeric values.
other utilities, as they would be able to rank their experiences
with banks or gas stations. That is, they might not know how
William P. Zarakas and Philip Q Hanser are Principals with The good or bad they have it. Nonetheless, utility customers certainly
Brattle Group. Kent Diep is a Research Analyst at The Brattle Group. have views about the quality and value of electric services, which
3,000
3,000 $250
$250
SAIDI Including Major Events (Minutes of Outage Duration)
SAIDI Including Major Events (Minutes of Outage Duration)
2,500
2,500
$200
$200
2,000
2,000
1,500
1,500
$100
$100
1,000
1,000
$50
$50
500
500
00 $0$0
500
500 550
550 600
600 650
650 700
700 750
750 800
800 500
500 550
550 600
600 650
650 700
700 750
750 800
800
J.D.
J.D.Power
PowerResidential
ResidentialCustomer
CustomerSatisfaction
SatisfactionScore
Score J.D.
J.D.Power
PowerResidential
ResidentialCustomer
CustomerSatisfaction
SatisfactionScore
Score
system that would deliver very high levels of reliability regardless might be expected to show directly observable relationships between
of the many perils it facesincluding ice storms, hurricanes, customer satisfaction and the various explanatory variables sum-
errant drivers, and even the potential damages of squirrels and marized above. For example, an electric utility that consistently
birdsbut it would likely come at a very high cost, especially if invested in and maintained its distribution systemsas evidenced
such hardening included undergrounding a significant percentage by above average levels of spendingmight be expected to realize
of their distribution systems. Thus, utilities have long sought an high levels of reliability. And if that same utility also had invested
algorithm that illuminates the customer trade-off of price versus and maintained customer service systems and had low rates, it
quality of service. Further, theyre interested in whether other levers, would achieve high customer satisfaction results. Finally, those
such as investment in customer service systems and customized relationships could be stretched into a matrix or algorithm, through
product offerings, might better fulfill their customers expectations. which utility managers could manage their way to strong customer
The Brattle Groups analysis seeks to confirm or refute the satisfaction. For example, perhaps they could spend a little less
views widely held by utility managers concerning the key factors on, say, distribution infrastructure per year, in order to keep rates
that determine customer satisfaction. It compiled a data set that down without triggering noticeable levels of system degradation,
covers utility performance (e.g., financial, system operations and with the overall result of happier customers.
customer satisfaction scores), levels of investment, operations All of this seems to make sense. However, as shown in Figures
and maintenance expenditures, and demographic characteristics 1 and 2, scatter plots of any two variables dont present any clear
(primarily concerning geography and customer density) for a panel pictures. Part of the explanation for this might lie in the com-
of roughly 30 investor-owned electric utilities located throughout plexity among relationships. Few if any utilities simultaneously
the United States, covering a period of six years.4 The primary achieve the combinations of spending, reliability, and rates to
factors considered in the analysis are summarized in Figure 1. clearly make the case.
Based on common utility wisdom, a quick look at these data Figures 2 and 3 depict the relationships between customer
satisfaction scores with reliability and price, respectivelyboth
4. In addition to the customer satisfaction scores from J.D. Power, data included
hypothesized to be important explanatory variables of customer
in this analysis come from several sources, primarily Form 1 reports filed
by electric utilities to the Federal Energy Regulatory Commission (FERC) satisfaction. These scatter plots indicate that the majority of
and from reliability reports made public by state regulatory commissions observations fall within a fairly tight range. However, fitting a
or from electric utilities themselves. Not all utilities have publicly available trend line within the scatter would be challenging at best. Fur-
information concerning customer satisfaction scores or consistent reliability thermore, scatter plots of two variables at a timei.e., customer
indicators. Thus, the size of the data set is limited by the public availability of
consistent data.
satisfaction scores versus a single independent variabledont
begin to explain the relative significance of a single explanatory
30
30 60
60
25
25 50
50
Frequency
Frequency
Frequency
Frequency
20
20 40
40
15
15 30
30
10
10 20
20
55 10
10
00 00
>1800
>1800
200 -- 400
400
400 -- 600
600
600 -- 800
800
800 -- 1000
1000
1000 -- 1200
1200
1200 -- 1400
1400
1400 -- 1600
1600
1600 -- 1800
1800
200
00 -- 200
500 -- 530
530
530 -- 560
560
560 -- 590
590
590 -- 620
620
620 -- 650
650
650 -- 680
680
680 -- 710
710
710 -- 740
740
740 -- 770
770
770 -- 800
800
200
400
600
500
530
560
590
620
650
680
710
740
770
800
1000
1200
1400
1600
J.D.
J.D.Power
PowerResidential
ResidentialCustomer
CustomerSatisfaction
SatisfactionScore
Score SAIDI
SAIDIIncluding
IncludingMajor
MajorEvents
Events(Minutes
(Minutesofofoutage
outageduration)
duration)
variable compared to other such variables. independent variables including: price, reliability, spending on
distribution systems, spending on customer service, the density
Interpreting Empirical Analysis of population in the utilitys service area, and the U.S. geographic
A review of the data included in the set confirmed definite dif- region where the utility is located.
ferences across utilities concerning customer satisfaction scores A summary of results is included in Figure 6. The key findings
as well as some of the key variables that might explain itsuch fall into four areas. First, the analysis indicated that, indeed,
as the extent of power outages. Figures 4 and 5 illustrate the system reliabilityas measured by the duration of service inter-
distribution of J.D. Power customer satisfaction scores (based ruptions, their frequency, or bothsignificantly explains customer
on surveys of residential electric customers) and the duration of satisfaction scores. Furthermore, a separate but related regression
power outages (SAIDI measured including major events) for the showed that spending by utilities on their distribution systems
utilities included in the panel. was significantly correlated with achieved levels of reliability.
The figures indicate that these data tend to be fairly tightly This confirms general understanding of the cycle and effect of
distributed, which means that differences across utilities might utility investment and operations and maintenance spending:
not be directly observable through a graphic or visual inspection. achieving high levels of reliability requires consistent investment
They also indicate that explaining the determinants of customer and spending.
satisfaction might require expressing some of the dependent Second, the analysis showed that ratesas measured by
variables in natural log form.5 average residential revenue per kWhplay a significant role in
A regression analysis confirmed much of the conventional explaining why customers rank utilities at a high or low level
wisdom concerning customer satisfaction and also provided a with respect to customer satisfaction. However, rate levels are
few additional insights as to causation.6 This analysis used util- less of a determinant than system reliability. In order to make
ity customer satisfaction score as the dependent variable, with the customer satisfaction scores more meaningful, the analysis
standardized the customer satisfaction variable,7 which allowed
5. It is clear that SAIDI scores are asymmetrically distributed, and appear to
more directly comparing the effect that independent variables
be approximate a log normal distribution. This means that we can change
the form of SAIDI to log normalor ln (SAIDI)to better express its
have upon the dependent variable. As indicated in Figure 6,
distribution in a regression analysis. improvements in reliability could increase customer satisfac-
6. Regression analysesassuming that the results are statistically significant
provide an indication of the importance of an independent variable in
7. Standardizing a variable involves centering it about the samples mean value
explaining changes in the dependent variable. As a general practice, the results
and dividing it by the samples standard deviation. This yields a customer
of a regression are summarized by displaying the coefficient of the independent
satisfaction variable that is measured relative to the panel of observations
variables considered, as well as indicating the degree to which those variables
(i.e., not in absolute terms).
are statistically significant (as measured by t-scores).
Turning
Energy
Inside
Out
Negawatts,
microgrids, and
every issue
Amory Lovins
in
FORTNIGHTLY
FORTNIGHTLY
PUBLICUTILITIES
Subscribe today:
fortnightly.com/subscribe
ENERGY, MONEY, POWER or sign up for a no obligation trial at
Your best source for unbiased and fortnightly.com/free-trial
insightful coverage of the critical issues or call 1-800-368-5001.
facing the energy industry.
customer needs and expectations. Segmentation can be enhanced, important to customers; quite the contrary is true. Customers
refined, or even outright changed, if utilities develop new tangible have come to expect that utilities provide electric service within
tools to address other unmet customer needs. For example, new a certain band of reliability and rates. Low ratesor rates that
programs enabled by smart meters, the smart grid, and services are as low as possibleplus reliable service then becomes the
related to plug-in hybrid electric vehicles will require that utilities common denominator of a utilitys customer satisfaction strategy.
apply more sophisticated segmentation tactics to tailor programs The geographic region of a utilitys service territory plays a strong
to meet customer expectations. role in customer satisfaction, the highest of all of the independent
Without this connection between segments and programs, variables considered. This could be interpreted to suggest that
however, segmentation is an academic exercise; utilities might achieving high levels of customer satisfaction is out of the control
be able to develop more nuanced, and perhaps more interesting of the utility in question. However, such an interpretation would be
segmentations of their custom- overly simplistic. Instead, this part of the regression results indicate
ers, but they will lack the abil-
Best practices that customer satisfaction is largely driven by utility attention to
ity to improve their customers aimed at the specific issues facing its unique customer base.
satisfaction. improving Is it possible to improve upon low customer satisfaction scores?
Of course, but it might take time to overcome embedded customer
Beyond Conventional
customer biases. This will be particularly true for electric utilities in the
Wisdom satisfaction Northeastern U.S., which are starting out with lower customer
Analysis provides an empirical scores arent satisfaction scores than is the case for utilities located elsewhere
basis for some of the conven- in the country. Regulators and other observers need to keep this
tional wisdom concerning the
always portable. point in mind when gauging progress going forward.
drivers of customer satisfaction In addition to meeting the common denominator of reliable
assumed by utility managers. It also places these drivers in electric service at low rates (or at least without notable increases
context. Most of the electric utilities in the panel have achieved in rates), electric utilities can improve upon their customer
relatively consistent and acceptable levels of reliabilityin terms satisfaction scores by improving observed deficiencies (such
of the frequency and duration of service interruptionswhich as communications and customer interactions) and tailoring
led to these factors being statistically significant. However, the marketing programs to meet the expectations of specific customer
tight cluster of these observations led to low coefficient values, segments, with marketing programs tangible enough to address
suggesting that improvements in reliability wouldnt move specific customer needs. Otherwise, generalized programs might
customer satisfaction scores that much. The same is true for rate make good sound bites, but arent actionable enough to improve
reductions. This doesnt mean that reliability and rates arent the satisfaction levels for any particular group of customers. F