You are on page 1of 62

IEEE and Patents:

An Objective Analysis of the Effect of


IEEE Publications on Subsequent
Patented Technology
www.ieee.org/discover

Prepared for:
IEEE
445 Hoes Lane
Piscataway, NJ 08855

Prepared by:
Anthony F. Breitzman, Ph.D.
CHI Research, Inc.

July 29, 2003


Introduction

In 2003,the IEEE commissioned CHI Research Inc., a worldwide leader in Intellectual Property consulting,
to take a look at how IEEE-published information influences patents in today’s top technologies.

According to CHI:
• Patents issued by the U.S. Patent office are citing scientific literature, especially IEEE information,
more than ever before
• IEEE-published science was cited more often than that of other scholarly and commercial publishers
• IEEE is the science base for the top patenting organizations

CHI Research’s methodologies have been featured prominently by BusinessWeek magazine, and used
by the U.S. Small Business Association to identify innovative companies.

CHI had already proven that patents which are themselves cited in later patents are a prime indicator of a
company’s growth potential. Says BusinessWeek (March 2004): “Each year since 2000, when CHI began
issuing monthly buy recommendations to institutional investors (subscription price: $15,000 a year), it
has killed the market averages. In 2003, as the average tech-stock mutual fund returned 55.9%, CHI’s
picks returned 162%.”

The complete CHI Research report is reproduced for you in this IEEE white paper.

About CHI Research Inc., the company BusinessWeek called “A Search Engine
For Tech Prospectors”
CHI Research, Inc. is a highly focused research consultancy internationally recognized for its leadership
in the development and analysis of technology and science indicators. Formed in 1968, CHI pioneered
the development of science and technology citation analysis.

Working with the U.S. National Science Foundation, CHI developed the first national-scale bibliometric
indicators of scientific performance in the early 1970s. Since then, CHI has produced all the literature-
to-literature, patent-to-literature and patent-to-patent citation indicators ever used in the congressionally
mandated Science and Engineering Indicators reports published by the U.S. National Science Board.

About IEEE
The IEEE is the world’s largest technical professional society with approximately 360,000 members in
170 countries. Through its members, the IEEE is a leading authority on areas ranging from aerospace,
computers and telecommunications to biomedicine, electric power and consumer electronics. The IEEE
produces 30 percent of the world’s literature in the electrical and electronics engineering and computer
science fields, and has developed more than 900 active industry standards. The organization also sponsors
or cosponsors more than 300 international technical conferences each year. Additional information is
available at www.ieee.org.

IEEE and Patents


Executive Summary

The IEEE engaged CHI to measure the impact of IEEE publications on patents that build upon
IEEE and competitor journal science. The key findings are:

1. A substantial amount of patented technology is built upon the foundation provided by scientific
literature. The IEEE provides much of that foundation for patents in the information technology
industry. IEEE publications have provided a significant scientific foundation for technological
development for years, but the IEEE is becoming increasingly important. In the five years
ending in 1997 and the five years ending in 2002 the numbers jumped to 31,228 and 57,357
respectively. That is, the number of references to IEEE papers in the last five years was 267%
higher than it was a decade earlier. Between the same periods, the number of US patents
increased only 76%, indicating that new technology is increasingly dependent upon papers
published in IEEE journals.

2. The increase in referencing from patented technology to IEEE publications is not driven by a few
key journals, but is broad-based. In fact, of the 62 IEEE journal titles covered by this study, all
but four have shown an increase in patent references in the last five and ten year periods.
Moreover, 55% of the IEEE journals have seen their numbers of patent references more than
double.

3. Determining the value of a large set of patents is an expensive and difficult problem. It has been
shown that citation analysis is a reasonable proxy, because high citation has been shown to be
associated with increases in sales, profits, and stock price. We have found that patents that
reference the IEEE are cited 15% more often than patents that do not reference IEEE, after
correcting for differences in age and technology. This 15% difference is statistically significant,
with the chance that the citation difference is due to random events shown to be less than one in
one million. This suggests that it is likely that the technology that builds upon IEEE science is
likely to be of more value than technology than peer technology not built on IEEE science.

4. In general, patents that build on IEEE science are cited more often than patents that do not.
However, for patents that build on a select set of IEEE journals such as T-IP, M-Net, M-CS, T-
SCM, and others the advantage is much greater. In particular, patents that reference T-IP are
cited 53% more than peer patents from the same technology and publication date. Similarly,
patents that reference M-Net and M-CS are cited 45% more than their peers.

5. A comparison of specific IEEE journals and competitor journals was undertaken as well.
Because of the large number of journals compared, the result is difficult to summarize briefly
(see text and Appendix B). However, in general, most of the IEEE journals are referenced in
patents more often than are the competitor journals.

ii

IEEE and Patents


6. Finally, an analysis of the referencing patterns of 18 selected patenting organizations was
examined. This analysis showed that the IEEE is the single most important publisher to the
Information Technology and Semiconductor industries. More precisely, the patented technology
of companies and universities in these industries builds upon science from the IEEE much more
often than science of other publishers and organizations.

7. Patents of the 18 selected organizations reference IEEE publications more than 37,000 times. In
other words, about 38% of the science references of these organizations are to IEEE publications.
The second place publisher, the American Institute of Physics, is referenced only 12,048 times
or 12.4% of the time.

8. Patents of Intel reference IEEE publications ten times as often as any other publisher.
Specifically, the 1983-2002 Intel patents referenced IEEE 1232 times (52%), and referenced the
second place ACM only 117 times (5%). Each of the other identified publishers was referenced
107 times or fewer from Intel patents.

iii

IEEE and Patents


Table of Contents

Section Page

I. Introduction 1

II. Patents Referencing IEEE Publication Methodology 2

III. Results 3

A. Patent Referencing Trends 3


B. Patent Citation Analysis of IEEE Linked Patents 3
C. Competitor Journal Analysis 6
D. Use of IEEE in Patents by Key Information Technology
Organization 8

IV. Conclusions and Recommendations 9

V. References 10

Appendix A: Brief Review of Studies Discussing the Relationship between


High Citations and Technological Importance A-1

Appendix B: Comparison of Patent Metrics of Patents Referencing


IEEE Journals vs. Competitor Journals B-1

Appendix C: Number of Patents Referencing Competitor Journals C-1

Appendix D: Top Cited Journals of Top Info. Technology Companies and


Universities (# Science References from 1983-2002 Patents to
Journal Articles) D-1

Appendix E: Publishers Receiving most References from 1983-2002 Patents


from Selected Information Technology Companies and
Universities E-1

iv

IEEE and Patents


List of Figures

Figure Page

1 Number of US Patent References to IEEE Publications for


Three Time Periods 14

2 Patent Referencing to IEEE Journals for Three Periods 15

3 Percent of IEEE Journals that have had an Increase in Patent


Referencing in the Last 5 Years 16

4 Patent Citation Analysis of IEEE Linked Patents versus Peer


Patents (All IEEE Journals with Statistically Significant
Results Shown) 17

5 Number of Patent References from 18 Selected Companies/


Universities to Top 18 Publishers 18

6 Percent of Patent References from 18 Selected Companies/


Universities to Top 18 Publishers 19

IEEE and Patents


I. Introduction

CHI Research was engaged in this study by the IEEE to measure the impact of IEEE publications on
patented technology. Several questions were addressed, such as: Are the patents that build upon
IEEE science better than those that do not? Are information technology patents more dependent on
IEEE science than on competitor science, and to what extent do key players build upon IEEE science
versus competitor journal science?

Unfortunately, there is not a direct relationship that would indicate that patents that build upon IEEE
science are worth X dollars more than those that do not. This would be ideal, but it is impossible,
since there is no way to quantify how much a patent citation is worth. However, it has been shown
that companies with highly cited patents in general perform better in terms of sales, profits, stock
price, and patent licensing, than companies with weakly cited patents. Thus by showing that IEEE
science has a positive influence on patent citations, it can be inferred that IEEE science indirectly has
a positive influence on these financial indicators.

The evidence that patent citations are positively correlated with financial performance has been
accumulating in the patent literature for some 40 years. A review of key validation studies for
patents citation analysis is contained in Appendix A.

The project had several tasks:

A. Patents that build upon IEEE publications were identified. Trends were examined to see
if recent patents are more likely to build upon IEEE publications than older patents.

B. A citation analysis was undertaken to determine whether patents that built upon IEEE
published science were more highly cited than peer patents.

C. An additional citation analysis was undertaken, comparing patents building upon


IEEE publications, versus patents building upon competitor journals.

D. A set of leading information technology companies and universities was identified.


The extent to which each organization uses IEEE versus competing publishers was
measured.

E. Brief analysis of findings is reported in this document.

IEEE and Patents


II. Patents Referencing IEEE Publication Methodology

The first task involved identifying all US patents with at least one front-page reference to an
IEEE publication. This is a difficult task, because there are no real rules or standard formats for
the way an applicant must cite a reference. This results in two major issues.

1. The journal name may appear anywhere in the reference, first, last, after the author,
before the author, etc.

2. The journal name may be abbreviated in dozens of different ways. For example Table 1
below shows some of the ways that the IEEE Journal of Solid-State Circuits shows up in
patent references.

Table 1 - Journal Variants for IEEE J of SSC


I.E.E.E. JOURNAL OF SOLID-STATE CIRCUITS
IEEE J OF S. S. CIRS.
IEEE J of Solid State Cir.
IEEE J OF SOLID STATE CIRCUIT
IEEE J of SSC
IEEE J Sol St Cir
IEEE J SOLID STATE CIRCUITS
IEEE J. OF S. S. CRTS
IEEE J. OF S.S. CIRCUITS
IEEE J. of S.-S. CKTS
IEEE J. OF SOL. ST. CIR.
IEEE J. OF SOL. ST. CIRCUITS
IEEE J. of Solid State Cir
IEEE Jnl. Solid-State Circuits
IEEE JNL. SOLID-STATE CKTS.
IEEE JO. OF SOLID STATE CKTS
IEEE JOR. OF SOLID STATE CIRCUITS
IEEE JOR. OF SSC
IEEE JOSSC
IEEE JOU. SOLID-STATE CIR.
IEEE Journal of Solid State Circuits
etc.

As part of its processing, CHI standardizes each patent reference, so that papers and journals
can be easily linked to patents. Therefore, identifying patents that build upon IEEE science is
easy using our internal databases.

IEEE and Patents


III. Results

A. Patent Referencing Trends

Figure 1 shows that patented technology is increasingly referencing IEEE publications. In the five-
year period ending 1992, there were 15,625 references to IEEE papers from US patents. In the five
years ending in 1997 and the five years ending with 2002 the numbers jumped to 31,228 and 57,357
respectively. That is, the number of references to IEEE papers in the last five years was 267% higher
than it was a decade earlier. During the same periods, the number of US patents increased only 76%,
indicating that new patents are increasingly building upon papers published in IEEE journals.

Figure 2 examines the referencing of individual IEEE journals. Again, the general trend is positive,
with most journals receiving many more references from patents in the most recent period than from
prior periods. Several journals that were not referenced in patents at all a decade ago are now cited
by hundreds of patents, including J-STQE, T-NET, T-SA, and others. Also, many journals that were
cited hundreds of times by patents a decade ago are cited thousands of times by recent patents.
Examples include T-PAMI, L-PT, and Spectrum among others.

All but four of the 62 journals have received more references from patents in the last five years than
from patents from the previous five years, and 34 of the 62 have seen their references increase by
more than 100%. In other words 55% of the IEEE journals are cited more than twice as often in
recent patents, than they were by patents from five years ago (see Figure 3). This again suggests that
the IEEE is becoming increasingly important to current technological developments.

B. Patent Citation Analysis of IEEE Linked Patents

Protecting technology products by trade secret is difficult, because these types of products can be
reverse-engineered. This is why high tech companies like Canon, IBM, Microsoft, and Intel have
more than 100,000 US patents combined. Moreover, for companies with fast moving technologies,
it is crucial to file patents early, so that is why patented technologies will often precede viable
products even in the information technology (IT) industry.

The net result is that the US has a vibrant and growing patent system that issues nearly 200,000
patents per year to inventors from 50+ countries. With such a vast system, it is inevitable that most
of the patents are worth very little, and that only a small number represent truly valuable innovations.

The problem of identifying the small percentage of truly valuable patents has long been recognized.
One of the most useful methods of identifying key patents is by identifying patents that are cited
frequently by other patents. High citation rates have been associated with seemingly unrelated
benefits such as increases in sales, profits, stock prices, licensing revenue, and inventor awards
among other things. A fairly complete literature review of patent citation validation studies can be
found in Appendix A.

IEEE and Patents


The studies described in Appendix A show that clearly highly cited patents in general have more
value than patents with few citations. However there is no formulaic relationship that would indicate
the value of a single citation. Not every highly cited patent is valuable and not every valuable patent
is highly cited. But these studies have shown that, in general a group of highly cited patents will tend
to be more valuable than a peer group with few citations.

Given this, the obvious question then is, are patents that build upon IEEE science more highly cited
than those that do not? If so, we would have a reason to believe that patents that build upon IEEE
science are more valuable than average patents, although we would not be able to quantify exactly
how much more valuable the IEEE linked patents are.

The main result is that patents that build upon IEEE publications are in general cited 15% more often
than peer patents from the same technology and published in the same time period. This overall
result is strong, but performance for some specific journals is even stronger. In order to discuss the
findings more fully, we need to step back a bit and discuss the method used for comparing the
citation impact.

Citations to patents vary by age and technology, so one must be careful when doing citation analysis.
For example a patent in a mature technology such as metal fabrication will receive fewer citations in
general than a patent in a dynamic technology such as consumer electronics. Similarly, a patent that
is five years old will have had more time to accumulate citations than a patent that is only two years
old.

To account for these issues, we took each patent that referenced any of the 62 IEEE journals and
randomly selected a cohort patent from the same technology class and publication year, so that we
had a randomly sampled peer patent for each IEEE linked patent. We obtained statistically
significant results for 42 of the 62 journals using a Wilcoxon signed rank test1. That is, for 42 IEEE
journals there is a significant difference between the citation patterns of the patents that reference
IEEE versus the peer patents that cannot be explained by a random event. The other 20 journals
either had two few patent references to get a statistically significant result, or there is no significant
difference between the citation patterns of the patents that reference the IEEE journals versus the
peer patents.

Note that getting a statistically significant result could mean either the IEEE linked patents are more
cited than the peer patents or less cited. In this case each of the patent sets linked to the 42 IEEE
journals was cited more frequently than its non-IEEE counterpart. Figure 4 shows that the patent sets
of the 42 journals were cited an average of 18% more often than the peer patents, with some journals

1
The Wilcoxon signed rank test is a significance test that can be applied to non-normally distributed large sets. In
this case it is used to determine whether one citation distribution is significantly different from a second. If the null
hypothesis is true, the sum of the ranks of the positive differences should be about the same as the sum of the ranks
of the negative differences, indicating that any difference in the citation impact could be random. See
http://www.itl.nist.gov/div898/software/dataplot/refman1/auxillar/signrank.htm for a formal definition.

IEEE and Patents


outperforming the peer patent sets by more than 40%.

As an example, consider IEEE Transactions on Image Processing shown at the top of the table.
There are 329 patents from 1983-2002 that reference this journal. These 329 patents are cited 1333
times in subsequent patents, while a random set of 329 patents selected from the same technology
and publication year were cited only 870 times. In this case the IEEE linked patents received 53%
more citations than the peer set. The significance value in this case is less than 0.0001. This
suggests that there is less than a 1 in 10,000 chance that no difference exists between patent that
reference the IEEE journals and those that do not.

Although the remaining 20 IEEE journals provided results that are not statistically significant, for
what it is worth the patents that reference these 20 journals are also slightly higher cited than their
peer group. Also, the patents linked to all 62 journals are cited 15% higher than their peer patents,
and this is a statistically significant result. In fact, the probability that the 15% advantage happened
as a random event is less than one in one million as Figure 4 indicates.

To review, there is much evidence that shows that high citation rates are associated with
increases in sales, profits, and stock prices. Patents that reference IEEE papers tend to be higher
cited than peer patents. It is therefore reasonable to assume that patents that build on IEEE
science, are in general more valuable than patents that do not.

C. Competitor Journal Analysis

In the previous section we discussed citation analysis by means of comparing a set of patents (those
that reference IEEE) with a random set of peer patents from the same technology class and era. This
allowed us to determine whether the IEEE linked patent set was cited more often than a random set
in a statistically significant way.

In this section, we compare patents that reference IEEE with patents that reference competitor
journals. This is a more difficult problem, because the comparison patents may be in different
technologies than the IEEE counterparts, or as a group they may be older or newer than the IEEE
linked patents, all of which will affect the citation counts.

To correct for these issues we use a citation index that allows for comparing patent sets of differing
ages and technologies in a precise and fair manner. To understand the citation index we need to
define the expected citation rate.

Consider an arbitrary patent in technology X and published in year Y. This patent may have 0, 1, 2,
or 100 or more citations; suppose it has C citations. Now consider all patents published in year Y
and classified in technology X. Suppose there are M such patents and combined they have N
citations. The expected citation rate for any of the patents in year Y and technology X is simply
N/M, and the citation index for our starting patent is just C/(N/M).

IEEE and Patents


So for example if our starting patent received 10 citations and it is in a class and year with 100
patents that have received 540 citations total. The expected citation rate for any of the 100 patents is
then 5.4 (540 divided by 100), so that the citation index of our starting patent is 1.85 (10 divided by
5.4). This indicates that our starting patent is cited 85% more than expected.

The citation index is strongest as an indicator of a set of patents rather than as an indicator of a
single patent. The citation index of a set of patents is just the sum of the citations to the set of
patents divided by the sum of the expected citations for the same set of patents.

Note that as described above, the citation index is normalized to remove age and technology biases
so that it has an expected value of 1.0. Thus a citation index of 1.5 indicates the patents are cited
50% more than expected, a citation index of 0.5 indicates the patents are cited 50% less than
expected and so on. In this way, two or more patent sets of different sizes, technologies, and ages,
can be compared in a reasonable way.

Appendix B shows the total citations, expected citations, and citation index for the top 30 IEEE
journals referenced in patents and for each competitor journal identified by IEEE staff. This
appendix contains a lot of information, so to avoid repetition only some highlights will be discussed
here in order to illustrate how the data can be interpreted.

The first journal shown in Appendix B is IEEE Transactions on Antennas and Propagation, or T-
AP. What is most striking here is not so much the citation index, but that IEEE T-AP is basically the
standard journal in this area. 774 patents reference T-AP, but none of the competing journals are
referenced by more than 86 patents. The total number of patent references to T-AP (5,640) is more
than four times the combined total of all of the competitor journals. In terms of citations we see that
patents citing T-AP are cited 20% (citation index = 1.2) more than expected. This is slightly lower
than the 1.3 for Radio Science, but that is based on only 86 patents. (Note that as patent sets get
larger they tend to regress to the expected value of 1.0).

Also note that the majority of patents that reference Radio Science also reference one or more IEEE
journals. We see for example in Appendix C, that of the 86 patents that reference Radio Science,
57% of these patents also reference at least one IEEE paper.

T-BME is dominant in its area as well. It is referenced more than twice as often as the leading rival,
and the citation index of T-BME patents is 30% above expected, and above the indices of most of
the rivals. Critical Reviews/Begal House is the only journal with a higher patent citation index (1.7),
but this is based on only 51 patents. Moreover 41% of these 51 patents also reference one or
more IEEE simultaneously, so it is difficult to argue that the citation strength of these patents is due
to their connection to Critical Reviews.

IEEE and Patents


T-CAS 1&2 ranks third in referenced patents and is tied for fifth in citation index. However, it isn’t
clear that the competitor journals are a perfect match. In particular, Applied Physics Letters and the
IBM Journal of R&D are both aimed at a less specific audience than that of T-CAS. In any case the
citation index of 1.2 indicates that patents that reference T-CAS are cited 20% higher than is
expected.

IEICE Tran. Elec. has about half as many patents reference it as T-CAS, but the citation index of
these patents is quite high at 1.7. Interestingly, the 315 patents that reference both IEICE Tran. Elec.
one or more IEEE journals have a citation index over 2. This suggests that patents that build upon
both IEICE and IEEE are of higher impact than patents that reference only one or the other.

The results for the rest of the journals in Appendix B are similar. In most cases, except where the
competitor journal is a general journal such as the Journal of Applied Physics, or Applied Physics
Letters, the IEEE publications enjoy a large lead in patent references over the competitor journals. In
addition to the cases mentioned above, T-SMC, T-MIT, T-IT, M-MICRO,
M-CG&A, T-C, T-CE, and M-COMM all enjoy a two to seven fold lead in patent references over the
nearest competitor journal. The interested reader is urged to examine Appendix B in detail for the
journals of interest to him or her.

D. Use of IEEE in Patents by Key Information Technology Organizations

In the previous two sections, analyses were carried out that examine the citation impact of patents
that reference the IEEE and competitor journals. By looking at who owns most of the patents that
cite to the IEEE and competitors, we see that not surprisingly the biggest users of IEEE and
competitor science are companies in the Information Technology (IT) and Semiconductor industries,
including telecom companies like Lucent, computer companies like IBM, and semiconductor
companies like Intel. Universities with strong IT components like MIT and the University of
California have patents that also frequently reference IEEE and competitor journals.

Of course in the earlier analyses the patent sets were selected because the patents either referenced
IEEE or a competitor journal; the question that remains is, if we select all patents of Intel, or Lucent,
or IBM for example, how often do these companies’ patents reference the IEEE journals versus those
of others.

Appendix D shows the top referenced journals of each of the top IT and Semiconductor companies
and universities. (Note that the university patents are restricted to IT related technology classes,
because both universities have a large number of chemical and biotechnology related patents that
skew the results.) In each case the IEEE journals are quite well represented.

IEEE and Patents


For example we see that AMD references J-SSC most often, and in fact not only is the top journal
referenced by AMD an IEEE journal, but so are three of the top five, four of the top ten, and nine of
the top twenty referenced journals. A quick scan of Appendix D reveals that AMD is not an isolated
case, but that most of the other companies are similarly dependent on IEEE science.

The results of Appendix D are certainly impressive, but they lead to the question of how dependent
are companies like AMD upon publications published by IEEE versus say, Elsevier or Wiley? These
questions are difficult to address unless the publishers of each journal are known. This is not a
problem for IEEE journals since IEEE most often appears in the journal name, but the same is not
true for journals published by Wiley, Elsevier, and others.

For the 8,713 journals covered by the Thomson/ISI database, the publishers can be obtained from the
following web site: http://www.isinet.com/cgi-bin/jrnlst/jlresults.cgi . But there are still several
hundred prominent journals that are not covered by Thomson/ISI. To identify the publishers for
these, we researched any journal that was referenced by 100 or more times total from the top 18
companies and universities. This allowed us to compile the list of top referenced publishers found in
Appendix E.

The first company in Appendix E is AMD. We see that AMD patents reference IEEE 1084 times or
nearly 42% of the time. CMP is the next most referenced publisher with only 201 references (7.8%)
followed by unknown with 141 references (5.1%). Recall again that the unknown component
consists of journals that are referenced fewer than 100 times total by the 18 selected organizations
and are also not part of the 8,713 core journals covered by Thomson/ISI. Note also, that even if all
of the unknown journals were published by CMP, which is extremely unlikely, IEEE would still be
referenced 3 times as often.

Results for the other 17 companies and universities are similar to those of AMD except for Canon.
Canon references the American Institute of Physics more frequently than IEEE, but this may be due
to Canon’s diverse business that included cameras, copiers, consumer electronics, etc. If the Canon
patents were restricted to IT and Semiconductor related patents, the IEEE may well be first.

Appendix E is rather interesting, but is unfortunately a bit long. The key result is therefore
summarized in Figures 5 and 6. Figure 5 shows the number of references to the top 18 publishers
from the 18 selected companies and universities. To eliminate unknown publishers, only journals
that are referenced at least 100 times total by the organizations are included. We see that the IEEE is
referenced 37041 times by the 18 organizations, or three times as often as second place American
Institute of Physics. The same graph is shown as a set of percentages in Figure 6. Note that the total
does not add up to 100%, since there are some 40+ more publishers not shown that each receive
fewer than 1% of the references.

IEEE and Patents


In summary, the IEEE provides most of the science base for the information technology and
semiconductor industry. The IEEE is the single most important publisher to these industries; more
precisely, the patented technology of companies and universities in these industries builds upon
science from the IEEE much more often than science of other publishers and organizations.

IEEE and Patents


IV. Conclusions and Recommendations

In this report it was shown that the IEEE has a strong and positive impact on patented technology. In
particular patents that build on IEEE science are likely to be of higher quality than peer patents that
do not build on IEEE science. Moreover, IEEE is the biggest and most important contributor of
science to patents from the IT and semiconductor industries. These are the key results. See the
executive summary for a review of all of the main results.

In terms of recommendations, not many can be made. The report shows that the IEEE is doing a
very good job of providing the science base for the IT community.

There are a few analyses that may be done to strengthen this report. All were beyond the scope
of this project, but may be appropriate now. Some examples include:

1. A drill down analysis by technology. We selected 18 top companies based on the frequency
of referencing to IEEE and competitor journals. Most of these companies were IT and
Semiconductor companies, but they also patent in other technologies. Moreover, the
semiconductor patents of other companies were not included. A more thorough analysis that
examines all patents from all companies and universities in technology subcategories such as
semiconductors, telecommunications, computer hardware, software, and optics, might be of
interest. In this way, we could determine where the IEEE truly has core competencies and
where it leads other publishers by the widest margin.

2. A case study that builds on the current results. We know from Appendix E that Intel patents
that reference scientific papers reference IEEE publications 52% of the time. This is a
wonderful result, but it stops there. Questions such as, what are the patented inventions that
build upon IEEE, and what are the specific IEEE publications that provide the science base
are still unanswered. A case study that drills down to the specific patents that use IEEE and
connects those patents to products might be of real interest.

3. Additional research of the unknown publishers in Appendix E. Recall that any journal
referenced at least 100 times by the patents of the 18 selected companies was looked up to
identify the publisher. The 100 cut-off was necessary, because of the labor involved in
identifying the publisher of an arbitrary journal. This still allowed for some 5-10% of
references to have unknown publishers, which unfortunately weakens the result a bit. A
follow-on project that identifies the rest of the unknown publishers would clean this report a
bit and strengthen the already strong results.

10

IEEE and Patents


V. References

[1] Albert M., Avery D., McAllister P, and Narin F. Direct Validation of Citation Counts as
Indicators of Industrially Important Patents, Research Policy 20 (1991) 251-259.

[2] Breitzman A, and Narin F. A Case for Patent Citation Analysis in Litigation, The Law
Works, 3 (3) (1996), 10-11 and 26-27.

[3] Breitzman, A., Thomas, P., and Cheney, P., Technological Powerhouse or Diluted
Competence, (Forthcoming in R&D Management).

[4] Breitzman A, and Narin F, US 6175824: Method and apparatus for choosing a stock
portfolio, based on patent indicators. (Patent Application US1999/353613, July 14, 1999).

[5] Carpenter M, Narin F, and Woolf P. Citation Rates to Technologically Important Patents,
World Patent Information 4 (1981) 160-163.

[6] Deng Z, Lev B, and Narin F., Science & Technology as Predictors of Stock Performance.
Financial Analysts Journal, 55 (5), (1999), 20-32.

[7] Griliches, Z, Patent Statistics as Economic Indicators: A Survey. Journal of Economic


Literature, 28 (1990) 1661-1707.

[8] Hall, B.H., Jaffe, A.B., and Trajtenberg, M. Market Value and Patent Citations: A First
Look. (NBER Working Paper No. W7741. National Bureau of Economic Research, Cambridge,
MA: June 2000).

[9] Harhoff D, Narin F, Scherer F.M. and Vopel K, Citation Frequency and the Value of
Patented Inventions. (Submitted to Reviews Economics & Statistics, March 5, 1998).

[10] Jaffe, A.B., Trajtenberg, Manuel, and Fogarty, Michael S. The Meaning of Patent
Citations: Report on the NBER/Case-Western Reserve Survey of Patentees. (NBER Working
Paper No. W7631. National Bureau of Economic Research, Cambridge, MA: April 2000).

[11] Industrial Research and Development, 13, (December 1980) 3.

[12] Lanjouw, J.O., and Schankerman, Mark. Stylized Facts of Patent Litigation: Value,
Scope and Ownership. (NBER Working Paper No. W6297. National Bureau of Economic
Research, Cambridge, MA: December 1997).

[13] Lev B., Intangibles Management, Measurement, and Reporting, (Brookings Institution Press,
Washington D.C., 2001).

11

IEEE and Patents


[14] Lotka, A. J., The Frequency Distribution of Scientific Productivity, Journal of the
Washington Academy of Sciences, (June 19, 1926) 317-323.

[15] Mogee, M.E., Patent Analysis Methods in Support of Licensing, Proceedings of the Annual
Meeting of the Technology Transfer Society, July 21-23, 1997, Denver, CO.

[16] Mogee, M.E., Patents And Technology Intelligence, in W.B. Ashton and R.A. Klavans
(eds.) Technical Intelligence for Business: Keeping Abreast of Science & Technology,
(Columbus, OH: Battelle Press, 1997).

[17] Mogee, M.E. and Kolar R.G., Patent Co-Citation Analysis Of Eli Lilly & Co. Patents,
Expert Opinion on Therapeutic Patents 9(3) (1999) 291-305.

[18] Narin F. The Strategic Applications of Technology Indicators Based on Patent Citation
Analysis, Patent World, April 1993.

[19] Narin F., Albert M., and Smith V., What Patents Tell You About Your Competition,
CHEMTECH, (February 1993) 52-59.

[20] Narin F. and Breitzman A., Inventive Productivity, Research Policy, 24, (1995) 507-519.

[21] Narin F., Tech-Line Background Paper, in Joe Tidd (ed.) From Knowledge Management to
Strategic Competence, Series on Technology Management (Imperial College Press, 2000).

[22] Oppenheim, C. Do Patent Citations Count? in Blaise Cronin and Helen Barsky Atkins,
(eds.) The Web of Knowledge: A Festschrift in Honor of Eugene Garfield, (AIS Monograph
Series, Information Today, Inc., Medford, NJ, 2000).

[23] Patent and Trademark Office. U.S. Department of Commerce, Technology Assessment
and Forecast. Sixth Report, June 1976.

[24] Patent and Trademark Office. U.S. Department of Commerce, Manual of Patent
Examining Procedures. Section 904.02, 6th edition (1995).

[25] Pavitt, K, Patent Statistics as Indicators of Innovative Activity: Possibilities and Problems,
Scientometrics 7 (1985) 6-17.

[26] Reisner P., A Machine Stored Citation Index to Patent Literature Experimentation and
Planning, in: H.P. Lunh (ed.) Proceedings of Automation and Scientific Communications Annual
Meeting 1963 (American Documentation Institute, Washington, DC, 1965).

12

IEEE and Patents


[27] Thomas, P. The Effect of Technological Impact Upon Patent Renewal Decisions,
Technology Analysis & Strategic Management, 11 (2) (1999) 181-197.

[28] Thomas, P. A Relationship between Research Indicators and Financial Performance. 6th
International Conference on Science & Technology Indicators, Leiden, The Netherlands, May 24-
27, 2000.

[29] Trajtenberg. M. A Penny for your Quotes: Patent Citations and the Value of
Innovations, Rand Journal, of Economics 21 (1990) 11.

[30] Worcester Polytechnic Institute, Analysis of Highly Cited Patents: Are They
Important? Report prepared for the U.S. Patent Office, (December 1988).

13

IEEE and Patents


Figure 1: Number of US Patent References to IEEE Publications
for Three Time Periods

70000

60000 57357
# Patent Refs to IEEE Papers

50000

40000
31228
30000

20000 15625

10000

0
1988-92 1993-97 1998-02
Patent Period

Copyright (c) 2002, CHI Research, Inc.

IEEE and Patents


Figure 2: Patent Referencing to IEEE Journals for Three Periods

# References # References # References


to IEEE to IEEE to IEEE
Journal from Journal from Journal from
Patents Patents Patents % Growth
issued 1988- issued 1993- issued 1998- (1993-97 vs
IEEE Full Name Code 92 97 2002 1998-02)
Selected Topics in Quantum Electronics, IEEE Journal of (J-STQE) J-STQE 0 1 175 17400%
Networking, IEEE/ACM Trans. on (T-NET) T-NET 0 12 295 2358%
Speech and Audio Processing, IEEE Trans. on (T-SA) T-SA 0 22 247 1023%
Circuits and Systems for Video Technology, IEEE Trans. on (T-CSVT) T-CSVT 0 44 469 966%
Computer Magazine (M-C) M-C 5 31 315 916%
Image Processing, IEEE Trans. on (T-IP) T-IP 0 36 357 892%
Reliability, IEEE Trans. on (T-R) T-R 5 20 106 430%
Parallel and Distributed Systems, IEEE Trans. on (T-PDS) T-PDS 0 54 260 381%
IEEE Engineering in Medicine and Biology Magazine (M-EMB) M-EMB 14 84 376 348%
Applied Superconductivity, IEEE Trans. on (T-ASC) T-ASC 0 48 206 329%
Power Electronics, IEEE Trans. on (T-PEL) T-PEL 0 39 166 326%
Knowledge and Data Engineering, IEEE Trans. on (T-KDE) T-KDE 0 73 298 308%
IEEE Signal Processing Magazine (M-SP) M-SP 0 55 222 304%
IEEE Network: The Magazine of Global Information Exchange (M-NET) M-NET 9 154 503 227%
Plasma Science, IEEE Trans. on (T-PS) T-PS 29 42 124 195%
Software Engineering, IEEE Trans. on (T-SE) T-SE 13 239 671 181%
Pattern Analysis and Machine Intelligence, IEEE Trans. on (T-PAMI) T-PAMI 103 410 1096 167%
Semiconductor Manufacturing, IEEE Trans. on (T-SM) T-SCM 6 97 247 155%
IEEE Photonics Technology Letters (L-PT) L-PT 71 1083 2745 153%
IEEE Trans. Industry Applications T-IA 114 211 532 152%
IEEE Computer Graphics and Applications Magazine (M-CG&A) M-CG&A 62 276 695 152%
Computer-Aided Design of Integrated Circuits and Systems, IEEE Trans. on (T-CAD) T-CAD 53 362 886 145%
IEEE Communications Magazine (M-COMM) M-COMM 149 707 1709 142%
Magnetics, IEEE Trans. on (T-MAG) T-MAG 1021 1596 3627 127%
IEEE Micro Magazine (M-MICRO) M-MICRO 20 315 693 120%
Solid-State Circuits, IEEE Journal of (J-SSC) J-SSC 1428 3346 7203 115%
Vehicular Technology, IEEE Trans. on (T-VT) T-VT 56 319 684 114%
Robotics and Automation, IEEE Trans. on (T-RA) T-RA 9 110 232 111%
Selected Areas in Communications, IEEE Journal on (J-SAC) J-SAC 280 869 1829 110%
Antennas and Propagation, IEEE Trans. on (T-AP) T-AP 252 290 591 104%
Medical Imaging, IEEE Trans. on (T-MI) T-MI 48 238 485 104%
Spectrum (SPEC) ?SPEC 369 577 1168 102%
Components and Packaging Technologies, IEEE Trans. on (T-CPMTA) T-CAPT 136 272 548 101%
Systems, Man, and Cybernetics, Part A,B,C - Merged, IEEE Trans. on (T-SMC_M) T-SMC_M 97 246 493 100%
Ultrasonics, Ferroelectrics, and Frequency Control, IEEE Trans. on (T-UFFC) T-UFFC 128 418 816 95%
Electromagnetic Compatibility, IEEE Trans. on (T-EMC) T-EMC 18 32 62 94%
IEEE Transactions on Industrial Electronics T-IE 111 133 241 81%
Neural Networks, IEEE Trans. on (T-NN) T-NN 10 133 240 80%
Biomedical Engineering, IEEE Trans. on (T-BME) T-BME 460 669 1196 79%
Circuits and Systems Part I, 2 Merged, IEEE Trans. on (T-CAS_M) T-CAS_M 176 495 865 75%
Geoscience and Remote Sensing, IEEE Trans. on (T-GRS) T-GRS 45 71 123 73%
Information Theory, IEEE Trans. on (T-IT) T-IT 229 647 1119 73%
Consumer Electronics, IEEE Trans. on (T-CE) T-CE 436 807 1350 67%
Communications, IEEE Trans. on (T-COMM) T-COMM 1026 1992 3311 66%
Electron Devices, IEEE Trans. on (T-ED) T-ED 1807 2755 4361 58%
Microwave Theory and Techniques, IEEE Trans. on (T-MTT) T-MTT 659 745 1147 54%
Automatic Control, IEEE Trans. on (T-AC) T-AC 43 75 114 52%
IEEE Electron Device Letters (L-ED) L-ED 767 1348 2013 49%
Aerospace and Electronic Systems, IEEE Trans. on (T-AES) T-AES 127 180 260 44%
Instrumentation and Measurement, Trans. on (T-IM) T-IM 113 170 239 41%
IEEE Circuits and Devices Magazine (M-C&D) M-C&D 36 84 118 40%
Broadcasting, IEEE Trans. on (T-BC) T-BC 55 86 119 38%
IEEE Intelligent Systems Magazine (M-IS) M-IS 16 115 157 37%
Signal Processing, IEEE Trans. on (T-SP) T-SP 633 1206 1627 35%
Proceedings of the IEEE ?P-IEEE 1412 2205 2872 30%
Nuclear Science, IEEE Trans. on (T-NS) T-NS 459 537 638 19%
Computers, IEEE Trans. on (T-C) T-C 913 1708 1984 16%
IEEE Design and Test of Computers Magazine (M-D&T) M-D&T 48 218 244 12%
J-STQE + J-QE 1342 1324 1421 7%
IEEE Control Systems Magazine (M-CS) M-CS 29 88 88 0%
Quantum Electronics, IEEE Journal of (J-QE) J-QE 1342 1323 1246 -6%
Power Systems, IEEE Trans. on (T-PWRS) T-PWRS 140 482 408 -15%
IEEE Software Magazine (M-SOFT) M-SOFT 38 228 146 -36%

More than 100% Growth

0 or Negative Growth

Copyright (c) 2002, CHI Research, Inc.

IEEE and Patents


Figure 3: Percent of IEEE Journals that have had an Increase in
Patent Referencing in the Last 5 Years

IEEE Journals whose


refs decreased.
6%

IEEE Journals whose


refs increased by IEEE Journals whose
12% to 95% refs increased by
39% more than 100%.
55%

IEEE and Patents


Figure 4: Patent Citation Analysis of IEEE Linked Patents versus Peer Patents
(All IEEE Journals with Statistically Significant Results Shown)

Patents Citations Patent Citation


Referencing to IEEE Citations Advantage for
IEEE Linked to Peer IEEE Linked Significance
Journal Abbrev. Journal Patents Patents Patents P
Image Processing, IEEE Trans. on T-IP 329 1333 870 53% 0.0001
IEEE Network: The Magazine of Global Information Exchange M-NET 542 7617 5241 45% 0.0001
IEEE Control Systems Magazine M-CS 132 1791 1237 45% 0.01
Semiconductor Manufacturing, IEEE Trans. on T-SCM 248 2166 1499 44% 0.000001
IEEE Circuits and Devices Magazine M-C&D 230 2857 1988 44% 0.02
IEEE Computer Graphics and Applications Magazine M-CG&A 762 8620 6113 41% 0.000001
Networking, IEEE/ACM Trans. on T-NET 245 1005 736 37% 0.001
Pattern Analysis and Machine Intelligence, IEEE Trans. on T-PAMI 1155 10512 7886 33% 0.000001
Reliability, IEEE Trans. on T-R 108 807 613 32% 0.02
IEEE Design and Test of Computers Magazine M-D&T 374 4946 3863 28% 0.001
Circuits and Systems for Video Technology, IEEE Trans. on T-CSVT 388 1554 1219 27% 0.001
IEEE Communications Magazine M-COMM 1878 24944 19762 26% 0.000001
IEEE Trans. Industry Applications T-IA 728 5656 4507 25% 0.000001
Vehicular Technology, IEEE Trans. on T-VT 712 9731 7856 24% 0.000001
Robotics and Automation, IEEE Trans. on T-RA 264 2091 1689 24% 0.005
Ultrasonics, Ferroelectrics, and Freq. Control, IEEE Trans. on T-UFFC 905 9042 7327 23% 0.00001
Systems, Man, and Cyber., Part A,B,C - Merged, IEEE Trans. on T-SMC_M 692 7212 5883 23% 0.005
Proceedings of the IEEE ?P-IEEE 6037 77880 63685 22% 0.000001
Information Theory, IEEE Trans. on T-IT 1348 15572 12935 20% 0.000001
Power Systems, IEEE Trans. on T-PWRS 593 4652 3888 20% 0.005
Selected Areas in Communications, IEEE Journal on J-SAC 2262 28531 23868 20% 0.000001
Automatic Control, IEEE Trans. on T-AC 191 1756 1470 19% 0.04
Biomedical Engineering, IEEE Trans. on T-BME 1813 23971 20113 19% 0.000001
Spectrum ?SPEC 1933 25410 21370 19% 0.000001
Software Engineering, IEEE Trans. on T-SE 730 7940 6711 18% 0.005
Circuits and Systems Part I, 2 Merged, IEEE Trans. on T-CAS_M 1268 10161 8599 18% 0.001
Medical Imaging, IEEE Trans. on T-MI 523 3634 3090 18% 0.005
Knowledge and Data Engineering, IEEE Trans. on T-KDE 304 3005 2557 18% 0.025
Communications, IEEE Trans. on T-COMM 4167 56354 48424 16% 0.000001
Components and Packaging Technologies, IEEE Trans. on T-CAPT 862 7259 6263 16% 0.001
Magnetics, IEEE Trans. on T-MAG 3344 24647 21497 15% 0.0001
IEEE Transactions on Industrial Electronics T-IE 465 4093 3582 14% 0.001
IEEE Photonics Technology Letters L-PT 2235 13052 11441 14% 0.000001
IEEE Electron Device Letters L-ED 3189 30510 26959 13% 0.000001
Computers, IEEE Trans. on T-C 2963 43866 38897 13% 0.000001
IEEE Engineering in Medicine and Biology Magazine M-EMB 373 2687 2393 12% 0.02
Computer-Aided Design of Int. Circ. and Systems, IEEE Trans. on T-CAD 805 7602 6773 12% 0.001
Solid-State Circuits, IEEE Journal of J-SSC 7284 60182 53737 12% 0.000001
IEEE Micro Magazine M-MICRO 918 7029 6297 12% 0.01
Signal Processing, IEEE Trans. on T-SP 2433 26388 23818 11% 0.000001
Electron Devices, IEEE Trans. on T-ED 6718 69509 62902 11% 0.000001
IEEE Signal Processing Magazine M-SP 266 1152 1056 9% 0.05
Total of All Journals with Statistically Significant Patent Citation
Differences 62716 658726 560614 18% 0.000001
20 Journals without Statistically Significant Patent Citation
Differences 12819 102957 101399 2%
Total 75535 761683 662013 15% 0.000001

Copyright (c) 2003, CHI Research, Inc.

IEEE and Patents


Figure 5: Number of Patent References from 18 Selected
Companies/Universities to Top 18 Publishers*

IEEE 37041
AMER INST
PHYSICS 12048

ELSEVIER SCIENCE 5420

IEE 4583
INST PURE APPLIED
PHYSICS 3471
ELECTROCHEMICAL
SOC INC 3033
ASSOC
COMPUTING MACH. 2540
OPTICAL SOC
AMER 2364
A V S AMER INST
PHYSICS 2326
AMER CHEMICAL
SOC 1857

IBM CORP 1694


AMERICAN
PHYSICAL SOC 1667

PENNWELL PUBL 1513


SPIE-INT SOC. OPT.
ENG. 1245
MRS-MAT. RES.
SOC. 1098
PERGAMON-
ELSEVIER 1049

CMP MEDIA 920

PENTON 886

0 5000 10000 15000 20000 25000 30000 35000 40000

*Publishers compiled from all journals referenced 100+ times total from 18 organizations.

Copyright (c) 2003, CHI Research, Inc.


IEEE and Patents
Figure 6: Percent of Patent References from 18 Selected
Companies/Universities to Top 18 Publishers*

IEEE 38.1%

AMER INST PHYSICS 12.4%

ELSEVIER SCIENCE 5.6%

IEE 4.7%
INST PURE APPLIED
PHYSICS 3.6%

ELECTROCHEMICAL SOC INC 3.1%

ASSOC COMPUTING MACH. 2.6%

OPTICAL SOC AMER 2.4%

A V S AMER INST PHYSICS 2.4%

AMER CHEMICAL SOC 1.9%

IBM CORP 1.7%

AMERICAN PHYSICAL SOC 1.7%

PENNWELL PUBL 1.6%

SPIE-INT SOC. OPT. ENG. 1.3%

MRS-MAT. RES. SOC. 1.1%

PERGAMON-ELSEVIER 1.1%

CMP MEDIA 0.9%

PENTON 0.9%

0.0% 10.0% 20.0% 30.0% 40.0% 50.0%

*Publishers compiled from all journals referenced 100+ times total from 18 organizations.

Copyright (c) 2003, CHI Research, Inc.


IEEE and Patents
Appendix A - Brief review of studies discussing the relationship between
high citations and technological importance.
In this section, we take a moment to review the evidence that patent indicators, and patent
citation indicators, are a useful technique for assessing the quality of an organization’s
patented technology. This review is a subset of a more thorough review in [21]. Another
thorough review on the topic can be found in [22].

The main point of this section is that there is compelling evidence that high citation rates
are associated with the importance of the technological discoveries in the patents being
cited. This does not guarantee that every highly cited patent is of importance, or that a
patent that is not highly cited is of little importance. It does argue, however, that a
company with a portfolio of highly cited patents is more likely to be technologically
successful than one whose patents are cited less frequently. In addition, there is emerging
evidence that citation indicators are indicative of, and in some cases predictive of,
company technological, economic, and stock market success.

Basics of Patent Citation Analysis

When a patent is published or issued, it typically contains several references (8 is the


average for US patents) that link the patent to the earlier cited prior art, and limit the
claims of the new patent. They point out where essential and related art already exists,
and delineate the property rights of the invention as determined by the patent office.

This is an oversimplification of course, and there is great variation in the referencing


rules for the various patent systems of the world. In the US system it is the applicant’s
responsibility to identify all relevant prior art upon which the new invention improves, or
which limits the claims of the current invention. The patent examiner may add to or
subtract from the list of references supplied by the applicant. The patent examiner is the
final arbiter of what is included, but he is "not called upon to cite all references that are
available, but only the best" [24]. The European patent system is quite different, with all
prior art references cited by the examiner, and none cited by the applicant. We will not
delve into patent law of the more than 40 significant national and international patent
systems, but only point out that before doing a patent citation analysis, it is important to
define what a citation means in the particular patent system being analyzed.

When the referencing pattern is turned around, and all of the subsequent citations to a
given patent are tabulated, one obtains the fundamental information used in patent
citation analysis, namely, a count of how often a given patent is cited in later patents.
These distributions tend to be very skewed: there are large numbers of patents that are
cited only a few times, and only a small number of patents cited more than ten times. For
example, for US patents issued in 1988, and cited in the next 7 years, half the patents are
cited 2 or fewer times, 75 percent are cited 5 or fewer times, and only one percent of the

A-1

IEEE and Patents


patents are cited 24 or more times. Overall, after 10 or more years the average number of
cites received per patent is around 6.

Validation Studies

There is no official standard by which the importance of a patent may be judged except,
perhaps, for the Federal Court’s designation of "pioneering patents" (discussed below).
Therefore, most of the studies of citation frequency and patent importance are based upon
the opinions of knowledgeable scientists or engineers, or correlations with non-patent
measures. Below is a chronological history of validation studies. It is by no means
exhaustive, but it shows that patent citation analysis has roots that go back to at least the
1960’s.

One of the earliest studies that looked at patent citations as a way of finding important
patents was done by Reisner [26] at IBM, who experimented with the use of citation
analysis to find key patents. By tracing the references from one patent to another, Reisner
found 43 of 60 patents she was looking for.

Computerized citation data covering all U.S. patents first became available in 1975. In
the following year, in the Sixth Technology Assessment and Forecast report [23], the
Patent & Trademark Office, tabulated the patents that were most highly cited and
suggested that "the number of times a patent document is cited may be a measure of its
technological significance."

In 1981 CHI, in a study sponsored by the NSF [5], showed that patents associated with
the IR-100 award received twice as many citations as a control set of patents of the same
age and in the same technologies. The IR-100 award, established by the journal Industrial
Research & Development, [11], “honors the 100 most significant new technical
products--and the innovators responsible for them--developed during the year.” Another
citation validation study was carried out by Worcester Polytechnic Institute students and
the U.S. Patent & Trademark Office. The last sentence in the abstract explains the key
result. “The results were found to support the hypothesis that highly cited patents are
important” [30].

In 1990, Manual Trajtenberg [29] found that patent citation counts were correlated with
an independent measure of the value of an innovation, measured as a function of price
and product attributes, called by economists the social gain stemming from the
innovation. He also pointed out the significant limitations of simple patent counts as a
measure of technological strength.

A validation study of patent citation analysis within an industrial context was carried out
by CHI Research in cooperation with Eastman Kodak Laboratories [1]. In that study, a
collection of nearly 100 Kodak patents in their core area of Silver Halide Technology
were divided into sets of 16 each, and the sets given to senior lab staff for evaluation. The
Kodak evaluators were senior intellectual property staff, senior lab management, and

A-2

IEEE and Patents


senior lab scientists. In the case of scientists, the patents they were given to rank were
screened, to make sure that they did not rank their own patents. Each person was asked to
rank the patents based on how much each has changed the state-of-the-art in the field of
the invention.

The results showed that whether a patent is cited one, two, or three times does not seem
to make much difference in the peer ranking. However, patents cited more than five times
were ranked far more highly by the Kodak staff. Of the 15 respondents in the study, eight
gave this group of patents the highest average rating. This is a statistically significant
result given that, using the binomial model, the probability of this happening randomly is
0.0002.

A 1996 study [2] examined citation frequencies of three different categories of special
patents: patents listed in the National Inventor’s Hall of Fame, patents of Historical
Significance in a list prepared by the U.S. Department of Commerce for the USPTO
bicentennial, and patents that had been adjudged as pioneering patents by the Federal
District Court. The term pioneer patent refers to patents that the courts have deemed to
be so groundbreaking that they deserve a wide interpretation of their claims.

The study found that pioneering patents are cited almost seven times as often as expected
(with the majority of citations occurring before their special designation). Hall of Fame
patents are cited more than six times as often as expected, and historically significant
almost 2.5 times as often as expected. Moreover, the results were not driven by a few
highly cited patents within each set; in fact, of all the patents in all three sets, only one
was cited fewer times than expected.

A 1998 study [9] used an interesting technique to examine importance versus citation
frequency. This study was based on patents on which profitability information--that is the
private value of the patents--was obtained. The authors considered only patents for which
all the fees had been paid to keep the patents in force in Germany for the full 18 years of
the patents. They queried the owners of those patents as to the asset value of the patent--
essentially asking, what is the smallest amount they would have been willing to sell this
patent to an independent third party for in 1980? In the German patent system the two
patents in the highest value category were much more highly cited than the others. In the
U.S. patent system the patent citation frequency of the patents with an estimated value of
$20 million or above were substantially more highly cited than the patents with lower
estimated values.

In 1999, Thomas, [27] found a correlation between patent citation counts and positive
renewal decisions. Essentially, he found that patents for which the renewal fees had been
paid were more highly cited then their counterparts that were allowed to lapse.

Also in 1999, Zhen Deng et al. [6] used a number of patent citation indicators to predict
stock performance. Other studies related to using citation indicators for choosing stocks
include Breitzman & Narin [4] which showed that a portfolio of stocks picked based on

A-3

IEEE and Patents


patent indicators outperforms the S&P 500 by 3-fold in a 10 year period. Finally, Thomas
[28] showed a patent indicator based method could identify stocks that are undervalued
based on the quality of their technology.

Increasingly, economists have begun to use measures based on patents and their citations
as indicators of technological output. Only a few are mentioned here. Hall, Jaffe, and
Trajtenberg [8] explored the contributions of R&D spending, patents, and citation-
weighted patents to measures of the financial market valuation of the firms that own the
patents for more than 4800 US manufacturing firms. They found that citation-weighted
patent counts were more highly correlated with market value than patent counts
themselves because of the high valuation placed on firms that hold very highly cited
patents. Jaffe, Trajtenberg, and Fogarty [10] surveyed 1993 US patentees regarding the
importance of their inventions, the extent of their communication with other inventors,
and the relationship of both importance and communication to observed patent citations.
They found a significant correlation between the number of citations a patent received
and its importance (both economic and technological) as perceived by the inventor.
Lanjouw and Schankerman [12] investigated the characteristics of litigated patents. They
found that, compared with a random sample of U.S. patents from the same cohorts and
technology areas, patents that were cited more often were considerably more likely to be
involved in litigation.

A-4

IEEE and Patents


Appendix B: Comparison of Patent Metrics of Patents Referencing
IEEE Journals vs. Competitor Journals

Journal Name/Publisher #Patents Referencing #Cites Received Expected Citation


Journal by Patents Cites Index

Antennas and Propagation, IEEE Trans. on (T-AP) 774 5640 5005.2 1.2

Radio Science (formerly Journal of Radi / Amer Geophys Union 86 750 555.9 1.3
Microwaves, Antennas & Propagation / IEE 75 327 273.0 1.2
Journal of Electromagnetic Waves & Ap / VSP 9 23 29.9 0.8
Electromagnetics(frmrly International Jo / Taylor & Francis 6 116 76.6 1.5
International Journal of RF & Microwave / John Wiley & Sons 5 7 6.2 1.1
Competitors Combined: 181 1223 941.7 1.3

Biomedical Engineering, IEEE Trans. on (T-BME) 1813 20113 18312.8 1.3

Medical and Biological Engineering & Co/ IEE 876 12126 10952.6 1.1
Annals of Biomedical Engineering / AIP 219 1590 1538.3 1.0
Biomedical Engineering / Kluwer 206 2930 2328.1 1.3
Journal Biomechanical Engineering / ASME 144 1112 887.8 1.3
Biomedical Instrumentation & Technolog / Hanley & Belfus 92 379 342.4 1.1
Critical Reviews in Biomedical Engineeri / Begell House 51 299 171.9 1.7
Medical Engineering and Physics / Elsevier 20 57 56.9 1.0
Competitors Combined: 1608 18493 16278.1 1.1

Circuits and Systems Part I, 2 Merged, IEEE Trans. 1268 8599 8839.0 1.2
on (T-CAS_M)
Applied Physics Letters / Amer Inst Physics 14067 116630 99150.5 1.2
IBM Journal of Research and Developm / IBM 2107 26593 18608.8 1.4
IEICE Transactions on Electronics / Oxford 519 2940 1774.6 1.7
Circuits, Devices and Systems / IEE 63 458 435.1 1.1
Computer Aided Geometric Design ( for / Elsevier 40 306 267.3 1.1
Analog Integrated Circuits & Signal Proc / Kluwer 18 76 56.8 1.3
International Journal of Circuit Theory a / John Wiley & Sons 17 102 70.7 1.4
Circuits, Systems and Signal Processing / Birkhauser 13 72 61.9 1.2
Formal Methods in System Design / Kluwer 2 9 11.0 0.8
Journal of Circuits, Systems and Compu / World Sci Pub 2 0 1.9 0.0
Finite Elements in Analysis and Design / Elsevier 1 8 10.9 0.7
Competitors Combined: 16849 147194 120449.6 1.2

Copyright (c) 2002, CHI Research, Inc.


Tuesday, July 01, 2003 B-1
IEEE and Patents
Appendix B: Comparison of Patent Metrics of Patents Referencing
IEEE Journals vs. Competitor Journals

Journal Name/Publisher #Patents Referencing #Cites Received Expected Citation


Journal by Patents Cites Index

Communications, IEEE Trans. on (T-COMM) 4167 48424 38593.9 1.4

Electronics Letters / IEE 7309 59037 52636.1 1.1


Computer Networks (formerly) Computer/ Elsevier 686 7748 3793.4 2.0
Signal Processing/Image Communicatio / Elsevier 318 1833 1311.4 1.4
European Transactions on Telecommuni/ ELE 119 645 469.6 1.4
Bell Labs Technical Journal / Sons 80 130 71.1 1.8
BT Technology Journal / BT Group 69 245 226.7 1.1
Computer Physics Communications / Elsevier 42 349 348.4 1.0
International Journal of Communication / John Wiley & Sons 15 72 29.8 2.4
International Journal of Wireless Informa / Kluwer and Plenum Pr 9 46 17.7 2.6
Journal of Communications Technology / MAIK NAUKA/INTERP 2 1 0.9 1.1
Journal of Communications and Network / AIEI Korean Inst. of C 0 0 0.0 0.0
Competitors Combined: 8649 70106 58905.2 1.2

Components and Packaging Technologies, IEEE 862 6263 5028.3 1.4


Trans. on (T-CPMTA)
Microelectronic Engineering / Elsevier 629 4183 2887.0 1.4
Semiconductor Science and Technology / IOP 206 1119 1021.8 1.1
Quality and Reliability engineering Intern / John Wiley & Sons 8 14 37.0 0.4
Active & Passive Electronic Components/ Francis (was)(Gordon 2 10 14.1 0.7
Quantum Electronics / Turpion 0 0 0.0 0.0
Competitors Combined: 845 5326 3959.9 1.3

Computer-Aided Design of Integrated Circuits and 805 6773 5425.1 1.4


Systems, IEEE Trans. on (T-CAD)
IBM Journal of Research and Developm / IBM 2107 26593 18608.8 1.4
Formal Methods in System Design / Kluwer 2 9 11.0 0.8
Journal of Circuits, Systems and Compu / World Sci Pub 2 0 1.9 0.0
Competitors Combined: 2111 26602 18621.7 1.4

Copyright (c) 2002, CHI Research, Inc.


Tuesday, July 01, 2003 B-2
IEEE and Patents
Appendix B: Comparison of Patent Metrics of Patents Referencing
IEEE Journals vs. Competitor Journals

Journal Name/Publisher #Patents Referencing #Cites Received Expected Citation


Journal by Patents Cites Index

Computers, IEEE Trans. on (T-C) 2963 38897 32739.7 1.3

ACM Transactions: Computer Systems / ACM 573 8942 3992.6 2.2


Computer Journal / Oxford Univ Press 305 4182 2358.0 1.8
IEICE Transactions Communications (B)/ IEICE 296 1329 1102.0 1.2
IEICE Transactions Computers (D) / IEICE 209 1223 821.4 1.5
SIAM Journal on Computing / SIAM 130 1525 952.7 1.6
Computers and Digital Techniques / IEE 13 149 223.0 0.7
Competitors Combined: 1526 17350 9449.7 1.8

Consumer Electronics, IEEE Trans. on (T-CE) 2045 17932 16259.2 1.1

The SMPTE Journal (formerly Journal o / Soc MP TV Eng 1088 12842 9988.5 1.3
JEI: Journal of Electronics Industry (JEI) / Dempa 3 23 31.0 0.7
Competitors Combined: 1091 12865 10019.5 1.3

Electron Devices, IEEE Trans. on (T-ED) 6718 62902 54690.3 1.3

Journal of Applied Physics / Amer Inst Physics 9902 83568 66592.0 1.3
Solid-State Technology / Pennwell 2265 23269 16230.2 1.4
Solid-State Electronics / Elsevier 1063 9679 9037.2 1.1
Microelectronic Engineering / Elsevier 629 4183 2887.0 1.4
NEC Research & Development / NEC Creative Ltd. (Dai 387 4082 3154.2 1.3
Semiconductor Science and Technology / IOP 206 1119 1021.8 1.1
International Journal of High Speed Elec / World Sci Pub 27 83 78.7 1.1
Advanced Functional Materials was (Adv/ John Wiley & Sons 1 0 0.1 0.0
Competitors Combined: 14480 125983 99001.2 1.3

IEEE Communications Magazine (M-COMM) 1878 19762 13364.0 1.8

Microwave Journal / Horizon House 840 5677 5590.3 1.0


Telephony / Primedia 628 11709 6644.8 1.8
Telecommunications / Horizon House 221 3778 1976.7 1.9
Network Magazine (free newsletter merg / CMP Media 6 17 4.4 3.8
Competitors Combined: 1695 21181 14216.1 1.5

Copyright (c) 2002, CHI Research, Inc.


Tuesday, July 01, 2003 B-3
IEEE and Patents
Appendix B: Comparison of Patent Metrics of Patents Referencing
IEEE Journals vs. Competitor Journals

Journal Name/Publisher #Patents Referencing #Cites Received Expected Citation


Journal by Patents Cites Index

IEEE Computer Graphics and Applications 762 6113 4971.3 1.7


Magazine (M-CG&A)
Computer Graphics World / PennWell Corp. 85 1109 618.1 1.8
Visual Computer / Springer 60 569 427.2 1.3
Computer Graphics Forum / Blackwell Publishing Lt 47 432 214.9 2.0
Game Developer E / CMP Media LLC 14 39 14.9 2.6
Computers & Graphics / Elsevier 4 49 21.4 2.3
Competitors Combined: 210 2198 1296.5 1.7

IEEE Electron Device Letters (L-ED) 3189 26959 24424.0 1.2

Applied Physics Letters / Amer Inst Physics 14067 116630 99150.5 1.2
Electronics Letters / IEE 7309 59037 52636.1 1.1
Journal of Electrochemical Society / Electrochem Soc 6461 58344 42600.4 1.4
Solid-State Electronics / Elsevier 1063 9679 9037.2 1.1
Semiconductor Science and Technology / IOP 206 1119 1021.8 1.1
International Journal of High Speed Elec / World Sci Pub 27 83 78.7 1.1
Compel / MCB Univ Press 11 62 69.6 0.9
Competitors Combined: 29144 244954 204594.3 1.2

IEEE Micro Magazine (M-MICRO) 918 6297 6064.9 1.1

Microprocessors & Microsystems / Elsevier 191 1212 1172.6 1.0


Journal of Systems Architecture / Elsevier 18 15 10.9 1.4
Competitors Combined: 209 1227 1183.5 1.0

IEEE Photonics Technology Letters (L-PT) 2235 11441 10012.3 1.3

Applied Physics Letters / Amer Inst Physics 14067 116630 99150.5 1.2
Electronics Letters / IEE 7309 59037 52636.1 1.1
Japanese Journal of Applied Physics / Institute of Pure & App 6746 50742 44163.4 1.1
Optics Letters / Optical Soc Am 3288 26337 19821.0 1.3
Optics Communications / Elsevier 1367 10271 9152.5 1.1
Microelectronic Engineering / Elsevier 629 4183 2887.0 1.4
Optical & Quantum Electronics / Kluwer 207 1487 1296.0 1.1
Semiconductor Science and Technology / IOP 206 1119 1021.8 1.1
Fiber & Integrated Optics (formerly Inter / Taylor & Francis 75 912 679.6 1.3
Competitors Combined: 33894 270718 230807.9 1.2

Copyright (c) 2002, CHI Research, Inc.


Tuesday, July 01, 2003 B-4
IEEE and Patents
Appendix B: Comparison of Patent Metrics of Patents Referencing
IEEE Journals vs. Competitor Journals

Journal Name/Publisher #Patents Referencing #Cites Received Expected Citation


Journal by Patents Cites Index

IEEE Trans. Industry Applications 728 4507 3629.5 1.5

Electronic Design / Penton 2586 30505 23629.7 1.3


Power / McGraw-Hill 96 544 534.0 1.0
Machine Vision and Applications / Springer 29 350 151.0 2.3
Generation, Transmission & Distribution / IEE 24 224 157.6 1.4
Transmission & Distribution World / Primedia 21 82 89.7 0.9
Electric Power Systems Research / Elsevier 17 253 115.4 2.2
Consulting-Specifying Engineer / Reed Business Inform 10 94 44.0 2.1
EPE Journal/European Power Electronic / E P E Association 9 14 18.6 0.8
Plant Engineering / Reed Business Inform 8 22 36.6 0.6
Electric Power Applications / IEE 1 1 15.9 0.1
Competitors Combined: 2801 32089 24792.5 1.3

Information Theory, IEEE Trans. on (T-IT) 1348 12935 10519.1 1.5

ACM Transactions: Information Systems / ACM 157 1469 603.3 2.4


Information Systems Journal / Elsevier 57 633 415.4 1.5
Journal of Cryptology / Springer International 49 382 279.2 1.4
Design Codes and Cryptography / Kluwer 15 25 28.7 0.9
Annals of Statistics / Inst Math 5 10 13.0 0.8
Problems of Information Transmission / Kluwer 5 15 28.3 0.5
MCSS: Mathematics of Control System / Springer 3 10 16.3 0.6
Competitors Combined: 291 2544 1384.2 1.8

Magnetics, IEEE Trans. on (T-MAG) 3344 21497 19939.3 1.2

Applied Physics Letters / Amer Inst Physics 14067 116630 99150.5 1.2
Journal of Applied Physics / Amer Inst Physics 9902 83568 66592.0 1.3
Physical Review B / Amer Physical Soc 1366 8905 8027.6 1.1
Competitors Combined: 25335 209103 173770.1 1.2

Medical Imaging, IEEE Trans. on (T-MI) 523 3090 3015.4 1.2

Physics in Medicine & Biology / Inst of Phys Press 560 3834 3597.7 1.1
Computers in Biology & Medicine / Elsevier 71 864 572.7 1.5
Computerized Medical Images & Graphi / Elsevier 63 341 133.5 2.6
Medical Image Analysis / Elsevier 7 0 0.6 0.0
Competitors Combined: 701 5039 4304.5 1.2

Copyright (c) 2002, CHI Research, Inc.


Tuesday, July 01, 2003 B-5
IEEE and Patents
Appendix B: Comparison of Patent Metrics of Patents Referencing
IEEE Journals vs. Competitor Journals

Journal Name/Publisher #Patents Referencing #Cites Received Expected Citation


Journal by Patents Cites Index

Microwave Theory and Techniques, IEEE Trans. on 1905 14318 14021.0 1.0
(T-MTT)
Journal of Microwave Power & Electrom / IMicroPwr 127 1549 965.5 1.6
International Journal of Infrared & Millim
/ Kluwer 80 370 434.1 0.9
Microwaves, Antennas & Propagation / IEE 75 327 273.0 1.2
International Journal of RF & Microwave / John Wiley & Sons 5 7 6.2 1.1
Microwave Engineering Europe (supple / Miller Freeman 3 51 17.6 2.9
Competitors Combined: 290 2304 1696.5 1.4

Nuclear Science, IEEE Trans. on (T-NS) 1168 8213 8657.0 1.0

Nuclear Instruments and Methods in Phy/ Elsevier 1359 8851 7638.6 1.2
Journal of Nuclear Medicine / Soc Nuclear Med 1249 8133 6303.6 1.3
Medical Physics / American Institute of P 871 7393 6108.5 1.2
Nuclear Technology / American Nuclear Soci 231 909 938.7 1.0
European Journal of Nuclear Medicine & / Springer 181 806 668.7 1.2
Applied Radiation and Isotopes / Elsevier 152 419 520.5 0.8
Nuclear Science and Engineering / American Nuclear Soci 60 430 370.3 1.2
Annals of Nuclear Energy / Elsevier 6 18 38.7 0.5
Competitors Combined: 4109 26959 22587.4 1.2

Pattern Analysis and Machine Intelligence, IEEE 1155 7886 6824.8 1.5
Trans. on (T-PAMI)
Optical Engineering / Int Soc Op Eng 2200 17551 14707.2 1.2
Pattern Recognition Letters / Pergamon/Elsevier 293 3664 2855.7 1.3
International Journal of Computer Vision / Kluwer 178 1187 601.3 2.0
Machine Learning / Kluwer 83 506 359.7 1.4
Image & Vision Computing / Elsevier 56 322 183.5 1.8
International Journal of Pattern Recognit / World Sci Pub 42 265 204.8 1.3
Machine Vision and Applications / Springer 29 350 151.0 2.3
Graphical Models (formerly Graphical M / Academic Press 0 0 0.0 0.0
Competitors Combined: 2881 23845 19063.2 1.3

Copyright (c) 2002, CHI Research, Inc.


Tuesday, July 01, 2003 B-6
IEEE and Patents
Appendix B: Comparison of Patent Metrics of Patents Referencing
IEEE Journals vs. Competitor Journals

Journal Name/Publisher #Patents Referencing #Cites Received Expected Citation


Journal by Patents Cites Index

Power Systems, IEEE Trans. on (T-PWRS) 593 3888 4007.9 1.2

Journal of Power Sources / Elsevier 471 2164 1670.7 1.3


International Journal of Electrical Power
/ Elsevier 103 1019 1124.2 0.9
Generation, Transmission & Distribution / IEE 24 224 157.6 1.4
Electric Power Components and System / Taylor & Francis 19 121 89.3 1.4
Electric Power Systems Research / Elsevier 17 253 115.4 2.2
Competitors Combined: 634 3781 3157.2 1.2

Quantum Electronics, IEEE Journal of (J-QE) 3098 25793 24162.3 1.1

Japanese Journal of Applied Physics / Institute of Pure & App 6746 50742 44163.4 1.1
Journal of the Optical Society of Americ / Optical Soc Am 2517 22226 16148.0 1.4
Optoelectronics / IEE 44 200 163.8 1.2
Applied Physics B: Lasers & Optics / Springer 12 94 51.6 1.8
Progress in Quantum Electronics / Elsevier 12 76 62.4 1.2
Quantum Electronics / Turpion 0 0 0.0 0.0
Competitors Combined: 9331 73338 60589.2 1.2

Selected Areas in Communications, IEEE Journal on 2262 23868 17249.8 1.6


(J-SAC)
Electronics Letters / IEE 7309 59037 52636.1 1.1
Computer Networks (formerly) Computer/ Elsevier 686 7748 3793.4 2.0
Signal Processing/Image Communicatio / Elsevier 318 1833 1311.4 1.4
Computer Communications / Elsevier 290 3046 1894.8 1.6
Computer Communication Review / ACM 203 1700 801.7 2.1
European Transactions on Telecommuni/ ELE 119 645 469.6 1.4
Bell Labs Technical Journal / Sons 80 130 71.1 1.8
BT Technology Journal / BT Group 69 245 226.7 1.1
Journal of Cryptology / Springer International 49 382 279.2 1.4
Computer Physics Communications / Elsevier 42 349 348.4 1.0
International Journal of Communication / John Wiley & Sons 15 72 29.8 2.4
Mobile Networks and Applications (MON / Kluwer 6 10 4.5 2.2
Journal of Communications Technology / MAIK NAUKA/INTERP 2 1 0.9 1.1
Journal of Communications and Network / AIEI Korean Inst. of C 0 0 0.0 0.0
Competitors Combined: 9188 75198 61867.6 1.2

Copyright (c) 2002, CHI Research, Inc.


Tuesday, July 01, 2003 B-7
IEEE and Patents
Appendix B: Comparison of Patent Metrics of Patents Referencing
IEEE Journals vs. Competitor Journals

Journal Name/Publisher #Patents Referencing #Cites Received Expected Citation


Journal by Patents Cites Index

Signal Processing, IEEE Trans. on (T-SP) (Includes 2433 23818 21696.7 1.2
Signal Processing Letters at no charge)
Electronics Letters / IEE 7309 59037 52636.1 1.1
Signal Processing / Elsevier 331 2478 1744.8 1.4
Digital Signal Processing (formerly Journ/ Academic Press 83 512 360.3 1.4
Radar, Sonar & Navigation / IEE 22 9 17.1 0.5
Circuits, Systems and Signal Processing / Birkhauser 13 72 61.9 1.2
Sampling Theory in Signal and Imaging / Sampling Publishing 0 0 0.0 0.0
Competitors Combined: 7758 62108 54820.2 1.1

Software Engineering, IEEE Trans. on (T-SE) 730 6711 4717.4 1.7

Software: Practice and Experience / John Wiley & Sons 493 5855 3297.3 1.8
Computer Journal / Oxford Univ Press 305 4182 2358.0 1.8
ACM Transactions: Programming Langu / ACM 290 2309 1574.7 1.5
Information Processing Letters / Elsevier 210 3272 2324.6 1.4
Journal of Systems & Software / Elsevier 55 429 403.0 1.1
Acta Informatica / Springer 48 668 482.7 1.4
ACM Transactions: Software Engineerin / ACM 21 70 85.6 0.8
Information & Software Technology / Elsevier 19 137 118.3 1.2
Formal Aspects of Computing / Springer-Verlag 8 33 31.2 1.1
Advances in Engineering Software (form / Elsevier 3 42 31.5 1.3
Automated Software Engineering / Kluwer 2 6 11.2 0.5
Programming and Computer Software / Plenum Press 2 10 3.0 3.3
International Journal on Software Tools f / Springer 1 0 0.1 0.0
Requirements Engineering / Springer 1 12 8.3 1.4
Empirical Software Engineering / Kluwer 0 0 0.0 0.0
Competitors Combined: 1458 17025 10729.7 1.6

Solid-State Circuits, IEEE Journal of (J-SSC) 7284 53737 51797.4 1.2

Electronics Letters / IEE 7309 59037 52636.1 1.1


IEICE Transactions on Electronics / Oxford 519 2940 1774.6 1.7
Analog Integrated Circuits & Signal Proc / Kluwer 18 76 56.8 1.3
Graphical Models (formerly Graphical M / Academic Press 0 0 0.0 0.0
Competitors Combined: 7846 62053 54467.5 1.1

Copyright (c) 2002, CHI Research, Inc.


Tuesday, July 01, 2003 B-8
IEEE and Patents
Appendix B: Comparison of Patent Metrics of Patents Referencing
IEEE Journals vs. Competitor Journals

Journal Name/Publisher #Patents Referencing #Cites Received Expected Citation


Journal by Patents Cites Index

Systems, Man, and Cybernetics, Part A,B,C - 692 5883 5052.4 1.4
Merged, IEEE Trans. on (T-SMC_M)
Biological Cybernetics / Springer 154 1532 1585.4 1.0
Management Science / Inst Mgmt Sci 53 348 304.2 1.1
Fuzzy Sets & Systems / Elsevier 49 399 373.3 1.1
International Journal of Intelligent Syste / John Wiley & Sons 41 557 243.1 2.3
Machine Vision and Applications / Springer 29 350 151.0 2.3
Journal of Computer and System Scienc / Academic Press 25 304 278.6 1.1
International Journal of Human-Comput / Elsevier 15 74 24.7 3.0
Journal of Dynamic Systems, Measurem / ASME 11 53 20.9 2.5
Decision Support Systems / Elsevier 5 13 22.5 0.6
Cybernetics & Systems International J/ Taylor & Francis 4 67 10.6 6.3
Control and Cybernetics / Polish Academy of Sci 1 0 1.1 0.0
Information Systems Research / INFORMS 0 0 0.0 0.0
Organization Science / Maruzen 0 0 0.0 0.0
Competitors Combined: 387 3697 3015.4 1.2

Ultrasonics, Ferroelectrics, and Frequency Control, 905 7327 6595.3 1.4


IEEE Trans. on (T-UFFC)
Journal of the Acoustical Society of Ame / Acoustical Society of A 1506 14812 11029.0 1.3
Ultrasonics / Butterworth 549 6398 4512.8 1.4
Journal of Ultrasonic Imaging / Dynamedia, Inc. 304 3851 2169.1 1.8
Journal of Sound and Vibration / Academic Press 97 533 489.1 1.1
Competitors Combined: 2456 25594 18200.1 1.4

Copyright (c) 2002, CHI Research, Inc.


Tuesday, July 01, 2003 B-9
IEEE and Patents
Appendix B: Comparison of Patent Metrics of Patents Referencing
IEEE Journals vs. Competitor Journals

Journal Name/Publisher #Patents Referencing #Cites Received Expected Citation


Journal by Patents Cites Index

Vehicular Technology, IEEE Trans. on (T-VT) 712 7856 5312.3 1.8

Electronics Letters / IEE 7309 59037 52636.1 1.1


Computer Networks (formerly) Computer/ Elsevier 686 7748 3793.4 2.0
Computer Communications / Elsevier 290 3046 1894.8 1.6
European Transactions on Telecommuni/ ELE 119 645 469.6 1.4
I E E Proceedings - Communications / IEE 101 559 498.8 1.1
International Journal of Vehicle Design / Interscience Enterprise 29 567 216.5 2.6
Vehicle System Dynamics / Swets & Zeitlinger 29 428 164.0 2.6
Wireless Networks / Kluwer 20 37 17.9 2.1
Wireless Personal Communications / Kluwer 16 33 20.1 1.6
Transportation Science / INFORMS 11 75 75.7 1.0
ITS Journal / Taylor & Francis 3 1 0.2 4.3
Electric Power Applications / IEE 1 1 15.9 0.1
Journal of Automobile Engineering (Inst / Professional Engineeri 1 3 0.9 3.5
Transportation Research. Part C: Emerg / Pergamon 1 13 6.5 2.0
International Journal of Heavy Vehicle S / Interscience Enterprise 0 0 0.0 0.0
International Journal of Vehicle Autonom / Interscience Enterprise 0 0 0.0 0.0
Journal of Communications and Network / AIEI Korean Inst. of C 0 0 0.0 0.0
Wireless Communications and Mobile C / John Wiley & Sons 0 0 0.0 0.0
Competitors Combined: 8616 72193 59810.3 1.2

Copyright (c) 2002, CHI Research, Inc.


Tuesday, July 01, 2003 B-10
IEEE and Patents
Appendix C: Number of Patents Referencing Competitor Journals
#Patents #Patents that
Referencing also Reference % Co-
Full Journal publisher Journal IEEE Referencing

Applied Physics Letters Amer Inst Physics 14067 4918 35.0


Journal of Applied Physics Amer Inst Physics 9902 3434 34.7
Electronics Letters IEE 7309 4059 55.5
Japanese Journal of Applied Phy Institute of Pure & Applie 6746 1960 29.1
Journal of Electrochemical Socie Electrochem Soc 6461 1533 23.7
Optics Letters Optical Soc Am 3288 1403 42.7
Electronic Design Penton 2586 1048 40.5
Journal of the Optical Society of Optical Soc Am 2517 868 34.5
Solid-State Technology Pennwell 2265 659 29.1
Optical Engineering Int Soc Op Eng 2200 790 35.9
IBM Journal of Research and De IBM 2107 1089 51.7
Journal of the Acoustical Society Acoustical Society of Am 1506 668 44.4
Optics Communications Elsevier 1367 536 39.2
Physical Review B Amer Physical Soc 1366 421 30.8
Nuclear Instruments and Method Elsevier 1359 431 31.7
Journal of Nuclear Medicine Soc Nuclear Med 1249 152 12.2
The SMPTE Journal (formerly J Soc MP TV Eng 1088 410 37.7
Solid-State Electronics Elsevier 1063 621 58.4
Medical and Biological Engineeri IEE 876 361 41.2
Medical Physics American Institute of Phy 871 332 38.1
Microwave Journal Horizon House 840 462 55.0
Computer Networks (formerly) C Elsevier 686 348 50.7
Microelectronic Engineering Elsevier 629 236 37.5
Telephony Primedia 628 223 35.5
ACM Transactions: Computer Sy ACM 573 374 65.3
Physics in Medicine & Biology Inst of Phys Press 560 228 40.7
Ultrasonics Butterworth 549 271 49.4
IEICE Transactions on Electronic Oxford 519 315 60.7
Software: Practice and Experien John Wiley & Sons 493 326 66.1
Journal of Power Sources Elsevier 471 35 7.4
NEC Research & Development NEC Creative Ltd. (Dai-Iti 387 188 48.6
Signal Processing Elsevier 331 259 78.2
Signal Processing/Image Comm Elsevier 318 193 60.7
Computer Journal Oxford Univ Press 305 173 56.7
Journal of Ultrasonic Imaging Dynamedia, Inc. 304 208 68.4
IEICE Transactions Communicati IEICE 296 167 56.4
Pattern Recognition Letters Pergamon/Elsevier 293 214 73.0
Computer Communications Elsevier 290 139 47.9
ACM Transactions: Programmin ACM 290 176 60.7
Nuclear Technology American Nuclear Societ 231 27 11.7
Telecommunications Horizon House 221 126 57.0
Annals of Biomedical Engineerin AIP 219 104 47.5
Information Processing Letters Elsevier 210 119 56.7
IEICE Transactions Computers ( IEICE 209 116 55.5
Optical & Quantum Electronics Kluwer 207 96 46.4

Copyright (c) 2002, CHI Research, Inc.


Monday, July 07, 2003 C-1

IEEE and Patents


Appendix C: Number of Patents Referencing Competitor Journals
#Patents #Patents that
Referencing also Reference % Co-
Full Journal publisher Journal IEEE Referencing

Semiconductor Science and Tec IOP 206 94 45.6


Biomedical Engineering Kluwer 206 91 44.2
Computer Communication Revie ACM 203 125 61.6
Microprocessors & Microsystems Elsevier 191 101 52.9
European Journal of Nuclear Me Springer 181 20 11.0
International Journal of Compute Kluwer 178 152 85.4
ACM Transactions: Information ACM 157 85 54.1
Biological Cybernetics Springer 154 125 81.2
Applied Radiation and Isotopes Elsevier 152 6 3.9
Journal Biomechanical Engineeri ASME 144 28 19.4
SIAM Journal on Computing SIAM 130 91 70.0
Journal of Microwave Power & El IMicroPwr 127 41 32.3
European Transactions on Telec ELE 119 80 67.2
International Journal of Electrical Elsevier 103 57 55.3
I E E Proceedings - Communicat IEE 101 85 84.2
Journal of Sound and Vibration Academic Press 97 16 16.5
Power McGraw-Hill 96 8 8.3
Biomedical Instrumentation & Te Hanley & Belfus 92 34 37.0
Radio Science (formerly Journal Amer Geophys Union 86 49 57.0
Computer Graphics World PennWell Corp. 85 46 54.1
Digital Signal Processing (former Academic Press 83 62 74.7
Machine Learning Kluwer 83 63 75.9
Bell Labs Technical Journal Sons 80 46 57.5
International Journal of Infrared Kluwer 80 44 55.0
Fiber & Integrated Optics (former Taylor & Francis 75 39 52.0
Microwaves, Antennas & Propag IEE 75 50 66.7
Computers in Biology & Medicin Elsevier 71 36 50.7
BT Technology Journal BT Group 69 36 52.2
Circuits, Devices and Systems IEE 63 49 77.8
Computerized Medical Images & Elsevier 63 43 68.3
Visual Computer Springer 60 44 73.3
Nuclear Science and Engineerin American Nuclear Societ 60 11 18.3
Information Systems Journal Elsevier 57 33 57.9
Image & Vision Computing Elsevier 56 41 73.2
Journal of Systems & Software Elsevier 55 41 74.5
Management Science Inst Mgmt Sci 53 22 41.5
Critical Reviews in Biomedical E Begell House 51 21 41.2
Fuzzy Sets & Systems Elsevier 49 36 73.5
Journal of Cryptology Springer International 49 20 40.8
Acta Informatica Springer 48 36 75.0
Computer Graphics Forum Blackwell Publishing Ltd. 47 34 72.3
Optoelectronics IEE 44 13 29.5
International Journal of Pattern R World Sci Pub 42 27 64.3
Computer Physics Communicati Elsevier 42 37 88.1
International Journal of Intelligen John Wiley & Sons 41 38 92.7

Copyright (c) 2002, CHI Research, Inc.


Monday, July 07, 2003 C-2

IEEE and Patents


Appendix C: Number of Patents Referencing Competitor Journals
#Patents #Patents that
Referencing also Reference % Co-
Full Journal publisher Journal IEEE Referencing

Computer Aided Geometric Desi Elsevier 40 27 67.5


Vehicle System Dynamics Swets & Zeitlinger 29 8 27.6
International Journal of Vehicle Interscience Enterprises 29 7 24.1
Machine Vision and Applications Springer 29 20 69.0
International Journal of High Spe World Sci Pub 27 13 48.1
Journal of Computer and System Academic Press 25 20 80.0
Generation, Transmission & Dist IEE 24 17 70.8
Radar, Sonar & Navigation IEE 22 6 27.3
ACM Transactions: Software En ACM 21 18 85.7
Transmission & Distribution Worl Primedia 21 7 33.3
Wireless Networks Kluwer 20 14 70.0
Medical Engineering and Physics Elsevier 20 3 15.0
Information & Software Technolo Elsevier 19 11 57.9
Electric Power Components and Taylor & Francis 19 8 42.1
Journal of Systems Architecture Elsevier 18 3 16.7
Analog Integrated Circuits & Sig Kluwer 18 17 94.4
Electric Power Systems Researc Elsevier 17 11 64.7
International Journal of Circuit T John Wiley & Sons 17 15 88.2
Wireless Personal Communicatio Kluwer 16 14 87.5
International Journal of Human- Elsevier 15 7 46.7
International Journal of Commun John Wiley & Sons 15 14 93.3
Design Codes and Cryptography Kluwer 15 9 60.0
Game Developer E CMP Media LLC 14 0 0.0
Computers and Digital Techniqu IEE 13 8 61.5
Circuits, Systems and Signal Pro Birkhauser 13 12 92.3
Progress in Quantum Electronics Elsevier 12 7 58.3
Applied Physics B: Lasers & Opti Springer 12 8 66.7
Compel MCB Univ Press 11 9 81.8
Journal of Dynamic Systems, Me ASME 11 6 54.5
Transportation Science INFORMS 11 0 0.0
Consulting-Specifying Engineer Reed Business Informati 10 0 0.0
Journal of Electromagnetic Wave VSP 9 7 77.8
International Journal of Wireless Kluwer and Plenum Pres 9 7 77.8
EPE Journal/European Power El E P E Association 9 5 55.6
Quality and Reliability engineerin John Wiley & Sons 8 4 50.0
Plant Engineering Reed Business Informati 8 3 37.5
Formal Aspects of Computing Springer-Verlag 8 7 87.5
Medical Image Analysis Elsevier 7 2 28.6
Mobile Networks and Application Kluwer 6 2 33.3
Electromagnetics(frmrly Internati Taylor & Francis 6 3 50.0
Annals of Nuclear Energy Elsevier 6 0 0.0
Network Magazine (free newslett CMP Media 6 2 33.3
Problems of Information Transmi Kluwer 5 3 60.0
Annals of Statistics Inst Math 5 3 60.0
Decision Support Systems Elsevier 5 2 40.0

Copyright (c) 2002, CHI Research, Inc.


Monday, July 07, 2003 C-3

IEEE and Patents


Appendix C: Number of Patents Referencing Competitor Journals
#Patents #Patents that
Referencing also Reference % Co-
Full Journal publisher Journal IEEE Referencing

International Journal of RF & Mic John Wiley & Sons 5 3 60.0


Cybernetics & Systems Intern Taylor & Francis 4 3 75.0
Computers & Graphics Elsevier 4 3 75.0
Advances in Engineering Softwar Elsevier 3 1 33.3
MCSS: Mathematics of Control Springer 3 2 66.7
Microwave Engineering Europe Miller Freeman 3 1 33.3
JEI: Journal of Electronics Indust Dempa 3 0 0.0
ITS Journal Taylor & Francis 3 1 33.3
Journal of Communications Tech MAIK NAUKA/INTERPE 2 2 100.0
Journal of Circuits, Systems and World Sci Pub 2 2 100.0
Formal Methods in System Desi Kluwer 2 2 100.0
Programming and Computer Soft Plenum Press 2 1 50.0
Automated Software Engineering Kluwer 2 2 100.0
Active & Passive Electronic Com Francis (was)(Gordon & 2 2 100.0
International Journal on Software Springer 1 1 100.0
Transportation Research. Part C: Pergamon 1 1 100.0
Requirements Engineering Springer 1 1 100.0
Electric Power Applications IEE 1 0 0.0
Finite Elements in Analysis and Elsevier 1 1 100.0
Journal of Automobile Engineeri Professional Engineering 1 0 0.0
Control and Cybernetics Polish Academy of Scien 1 0 0.0
Advanced Functional Materials w John Wiley & Sons 1 0 0.0

Copyright (c) 2002, CHI Research, Inc.


Monday, July 07, 2003 C-4

IEEE and Patents


Appendix D - Top Cited Journals of Top Info. Technology Companies and Universities
(# Science References from 1983-2002 Patents to Journal Articles)
Company/University rank Journal #Science Refs Percent
AMD 1 IEEE J SOLID-STATE CIRCUITS 222 8.6
AMD 2 BYTE 192 7.4
AMD 3 IEEE TRANS ELECTRON DEVICES 192 7.4
AMD 4 IEEE ELECTRON DEV LETT 143 5.5
AMD 5 J ELECTROCHEM SOC 126 4.9
AMD 6 IEEE TRANS COMPUT 117 4.5
AMD 7 IBM J RES DEVELOP 74 2.9
AMD 8 ELECTRONICS DESIGN 71 2.7
AMD 9 APPL PHYS LETT 68 2.6
AMD 10 ELECTRONICS 67 2.6
AMD 11 IEEE MICRO 67 2.6
AMD 12 SOLID STATE TECHNOL 58 2.2
AMD 13 J APPL PHYS 57 2.2
AMD 14 COMPUT DES 44 1.7
AMD 15 IEEE TRANS COMMUN 41 1.6
AMD 16 MAT RES SOC SYMP PROC 41 1.6
AMD 17 IEEE TRANS CIRCUIT SYST 40 1.5
AMD 18 PROC IEEE 39 1.5
AMD 19 COMPUTER ARCHITECTURE NEWS 38 1.5
AMD 20 IEEE TRANS SEMICONDUCT MANUF 37 1.4
Other IEEE Journals 186 7.1
Other non-IEEE Journals 671 26.0
Total 2591 100.0

Total IEEE 1084 41.8


Total non-IEEE 1507 58.2

Company/University rank Journal #Science Refs Percent


Canon 1 APPL PHYS LETT 635 9.0
Canon 2 J APPL PHYS 448 6.4
Canon 3 JPN J APPL PHYS 297 4.2
Canon 4 THIN SOLID FILMS 248 3.5
Canon 5 J ELECTROCHEM SOC 226 3.2
Canon 6 APPL ENVIRON MICROBIOL 168 2.4
Canon 7 J AMER CHEM SOC 143 2.0
Canon 8 RADIO ENG ELECTRON PHYS ENGL 128 1.8
Canon 9 J VACUUM SOC JAPAN 121 1.7
Canon 10 APPLIED OPTICS 109 1.5
Canon 11 ELECTRON LETT 109 1.5
Canon 12 ADVAN ELECTRON ELECTRON PHYS 109 1.5
Canon 13 IEEE TRANS ELECTRON DEVICES 106 1.5
Canon 14 J CRYST GROWTH 99 1.4
Canon 15 PHYS REV LETT 95 1.4
Canon 16 MOL CRYST LIQUID CRYST 79 1.1
Canon 17 PROC IEEE 76 1.1
Canon 18 J VAC SCI TECHNOL B 66 0.9
Canon 19 IEEE TRANS COMMUN 65 0.9
Canon 20 J VAC SCI TECHNOL 57 0.8
Other IEEE Journals 620 8.8
Other non-IEEE Journals 3030 43.1
Total 7034 100.0
Total IEEE 867 12.3
Total non-IEEE 6167 87.7

Tuesday, June 03, 2003 D-1

IEEE and Patents


Top Cited Journals of Top Information Technology Companies and Universities
(# Science References from 1983-2002 Patents to Journal Articles)
Company/University rank Journal #Science Refs Percent
Fujitsu 1 APPL PHYS LETT 411 8.6
Fujitsu 2 ELECTRON LETT 277 5.8
Fujitsu 3 JPN J APPL PHYS 212 4.4
Fujitsu 4 IEEE J SOLID-STATE CIRCUITS 189 4.0
Fujitsu 5 J APPL PHYS 182 3.8
Fujitsu 6 IEEE PHOTONIC TECHNOL LETT 166 3.5
Fujitsu 7 IEEE TRANS ELECTRON DEVICES 146 3.1
Fujitsu 8 J LIGHTWAVE TECHNOL 131 2.7
Fujitsu 9 J ELECTROCHEM SOC 116 2.4
Fujitsu 10 J CRYST GROWTH 102 2.1
Fujitsu 11 APPLIED OPTICS 83 1.7
Fujitsu 12 IEEE ELECTRON DEV LETT 77 1.6
Fujitsu 13 IEEE TRANS ON MAGNETICS 70 1.5
Fujitsu 14 OPTICS LETTERS 70 1.5
Fujitsu 15 IEEE TRANS COMMUN 64 1.3
Fujitsu 16 PROC IEEE 62 1.3
Fujitsu 17 IEEE J QUANTUM ELECTRON 61 1.3
Fujitsu 18 IEEE J SEL AREA COMMUN 61 1.3
Fujitsu 19 IEEE TRANS COMPUT 57 1.2
Fujitsu 20 J VAC SCI TECHNOL B 56 1.2
Other IEEE Journals 632 13.2
Other non-IEEE Journals 1546 32.4
Total 4771 100.0

Total IEEE 1585 33.2


Total non-IEEE 3186 63.8

Company/University rank Journal #Science Refs Percent


Hitachi 1 APPL PHYS LETT 390 5.0
Hitachi 2 IEEE J SOLID-STATE CIRCUITS 325 4.2
Hitachi 3 JPN J APPL PHYS 232 3.0
Hitachi 4 J APPL PHYS 226 2.9
Hitachi 5 IEEE TRANS ELECTRON DEVICES 198 2.6
Hitachi 6 IEEE TRANS ON MAGNETICS 196 2.5
Hitachi 7 ANAL CHEM 167 2.2
Hitachi 8 IEEE TRANS CONSUM ELECTRON 161 2.1
Hitachi 9 J VAC SCI TECHNOL 121 1.6
Hitachi 10 IEEE TRANS COMPUT 116 1.5
Hitachi 11 ELECTRON LETT 115 1.5
Hitachi 12 ELECTRONICS 87 1.1
Hitachi 13 SCIENCE 85 1.1
Hitachi 14 NATURE -INCLUDE LETT TO NAT 85 1.1
Hitachi 15 COMMUN ACM 84 1.1
Hitachi 16 J VAC SCI TECHNOL B 81 1.0
Hitachi 17 IBM J RES DEVELOP 75 1.0
Hitachi 18 APPLIED OPTICS 74 1.0
Hitachi 19 PHYS REV LETT 74 1.0
Hitachi 20 PROC IEEE 69 0.9
Other IEEE Journals 915 11.7
Other non-IEEE Journals 3874 50.1
Total 7750 100.0
Total IEEE 1980 25.5
Total non-IEEE 5770 74.5

Tuesday, June 03, 2003 D-2

IEEE and Patents


Top Cited Journals of Top Information Technology Companies and Universities
(# Science References from 1983-2002 Patents to Journal Articles)
Company/University rank Journal #Science Refs Percent
HP 1 HEWLETT-PACKARD J 407 5.8
HP 2 IEEE TRANS COMPUT 278 3.9
HP 3 APPL PHYS LETT 230 3.3
HP 4 ANAL CHEM 173 2.5
HP 5 BYTE 155 2.2
HP 6 COMMUN ACM 146 2.1
HP 7 PROC IEEE 140 2.0
HP 8 ELECTRON LETT 130 1.8
HP 9 J CHROMATOGR 111 1.6
HP 10 IBM J RES DEVELOP 108 1.5
HP 11 COMPUT DES 104 1.5
HP 12 IEEE J SOLID-STATE CIRCUITS 90 1.3
HP 13 IEEE TRANS COMMUN 89 1.3
HP 14 ELECTRONICS DESIGN 86 1.2
HP 15 IEEE TRANS ELECTRON DEVICES 81 1.1
HP 16 IBM SYST J 81 1.1
HP 17 IEEE J QUANTUM ELECTRON 73 1.0
HP 18 SOFTWARE-PRACT EXP 72 1.0
HP 19 APPLIED OPTICS 71 1.0
HP 20 J ELECTROCHEM SOC 71 1.0
Other IEEE Journals 1196 16.9
Other non-IEEE Journals 3154 44.8
Total 7046 100.0

Total IEEE 1947 27.6


Total non-IEEE 5099 72.4

Company/University rank Journal #Science Refs Percent


IBM 1 APPL PHYS LETT 863 5.4
IBM 2 IEEE TRANS COMPUT 657 4.1
IBM 3 J APPL PHYS 563 3.5
IBM 4 IBM J RES DEVELOP 495 3.1
IBM 5 IEEE TRANS ON MAGNETICS 462 2.9
IBM 6 IEEE J SOLID-STATE CIRCUITS 448 2.8
IBM 7 COMMUN ACM 356 2.2
IBM 8 J ELECTROCHEM SOC 345 2.2
IBM 9 IEEE TRANS ELECTRON DEVICES 320 2.0
IBM 10 PROC IEEE 242 1.5
IBM 11 PHYS REV LETT 232 1.5
IBM 12 IBM SYST J 232 1.5
IBM 13 JPN J APPL PHYS 208 1.3
IBM 14 J VAC SCI TECHNOL 188 1.2
IBM 15 IEEE ELECTRON DEV LETT 188 1.2
IBM 16 IEEE TRANS COMMUN 179 1.1
IBM 17 J VAC SCI TECHNOL B 164 1.0
IBM 18 SOLID STATE TECHNOL 148 0.9
IBM 19 IEEE TRANS SOFTWARE ENG 145 0.9
IBM 20 IEEE TRANS INFORM THEORY 142 0.9
Other IEEE Journals 1877 11.7
Other non-IEEE Journals 7506 47.1
Total 15960 100.0
Total IEEE 4660 29.2
Total non-IEEE 11300 70.8

Tuesday, June 03, 2003 D-3

IEEE and Patents


Top Cited Journals of Top Information Technology Companies and Universities
(# Science References from 1983-2002 Patents to Journal Articles)
Company/University rank Journal #Science Refs Percent
Intel 1 IEEE MICRO 250 10.6
Intel 2 IEEE J SOLID-STATE CIRCUITS 216 9.2
Intel 3 J ELECTROCHEM SOC 96 4.1
Intel 4 IEEE TRANS COMPUT 76 3.2
Intel 5 IEEE TRANS ELECTRON DEVICES 74 3.1
Intel 6 APPL PHYS LETT 72 3.1
Intel 7 PROC IEEE 65 2.8
Intel 8 IEEE TRANS COMMUN 54 2.3
Intel 9 COMPUTER (IEEE COMPUTER MAG) 51 2.2
Intel 10 ELECTRON LETT 47 2.0
Intel 11 COMMUN ACM 46 2.0
Intel 12 IEEE TRANS CONSUM ELECTRON 45 1.9
Intel 13 IEEE ELECTRON DEV LETT 41 1.7
Intel 14 COMPUT DES 36 1.5
Intel 15 J APPL PHYS 34 1.4
Intel 16 MAT RES SOC SYMP PROC 33 1.4
Intel 17 IEEE SPECTRUM 31 1.3
Intel 18 SOLID STATE TECHNOL 29 1.2
Intel 19 ELECTRONICS DESIGN 27 1.1
Intel 20 IEEE TRANS ACOUST SPEECH SIGN 24 1.0
Other IEEE Journals 305 12.9
Other non-IEEE Journals 698 29.7
Total 2350 100.0

Total IEEE 1232 52.4


Total non-IEEE 1118 47.6

Company/University rank Journal #Science Refs Percent


Lucent 1 APPL PHYS LETT 1346 8.9
Lucent 2 ELECTRON LETT 1187 7.8
Lucent 3 IEEE TRANS COMMUN 564 3.7
Lucent 4 BELL SYST TECH J 509 3.4
Lucent 5 IEEE PHOTONIC TECHNOL LETT 489 3.2
Lucent 6 J LIGHTWAVE TECHNOL 480 3.2
Lucent 7 PROC IEEE 438 2.9
Lucent 8 J APPL PHYS 393 2.6
Lucent 9 OPTICS LETTERS 361 2.4
Lucent 10 IEEE J QUANTUM ELECTRON 337 2.2
Lucent 11 IEEE J SOLID-STATE CIRCUITS 301 2.0
Lucent 12 APPLIED OPTICS 285 1.9
Lucent 13 IEEE J SEL AREA COMMUN 242 1.6
Lucent 14 IEEE TRANS ELECTRON DEVICES 228 1.5
Lucent 15 J ELECTROCHEM SOC 224 1.5
Lucent 16 JPN J APPL PHYS 219 1.4
Lucent 17 AT&T TECH J 210 1.4
Lucent 18 IEEE TRANS ACOUST SPEECH SIGN 189 1.2
Lucent 19 IEEE ELECTRON DEV LETT 184 1.2
Lucent 20 IEEE TRANS COMPUT 180 1.2
Other IEEE Journals 2165 15.3
Other non-IEEE Journals 4616 29.5
Total 15147 100.0
Total IEEE 5317 35.1
Total non-IEEE 9830 64.9

Tuesday, June 03, 2003 D-4

IEEE and Patents


Top Cited Journals of Top Information Technology Companies and Universities
(# Science References from 1983-2002 Patents to Journal Articles)
Company/University rank Journal #Science Refs Percent
Matsushita Electric 1 APPL PHYS LETT 357 6.8
Matsushita Electric 2 JPN J APPL PHYS 274 5.2
Matsushita Electric 3 IEEE TRANS CONSUM ELECTRON 237 4.5
Matsushita Electric 4 J APPL PHYS 223 4.3
Matsushita Electric 5 ELECTRON LETT 154 2.9
Matsushita Electric 6 IEEE TRANS ELECTRON DEVICES 111 2.1
Matsushita Electric 7 SMPTE J-SOC MOT PIC TELE ENG 110 2.1
Matsushita Electric 8 IEEE TRANS ON MAGNETICS 105 2.0
Matsushita Electric 9 APPLIED OPTICS 83 1.6
Matsushita Electric 10 IEEE TRANS COMMUN 83 1.6
Matsushita Electric 11 IEEE TRANS COMPUT 81 1.5
Matsushita Electric 12 IEEE TRANS MICROW THEORY TECH 79 1.5
Matsushita Electric 13 IEEE J SOLID-STATE CIRCUITS 76 1.5
Matsushita Electric 14 J ELECTROCHEM SOC 76 1.5
Matsushita Electric 15 THIN SOLID FILMS 66 1.3
Matsushita Electric 16 IEEE J QUANTUM ELECTRON 62 1.2
Matsushita Electric 17 PROC IEEE 56 1.1
Matsushita Electric 18 PROC SOC PHOTO-OPT INSTR ENG 55 1.1
Matsushita Electric 19 J CRYST GROWTH 54 1.0
Matsushita Electric 20 IEEE TRANS ACOUST SPEECH SIGN 49 0.9
Other IEEE Journals 548 10.5
Other non-IEEE Journals 2299 43.9
Total 5238 100.0

Total IEEE 1487 28.4


Total non-IEEE 3751 71.6

Company/University rank Journal #Science Refs Percent


Micron Technology 1 IEEE J SOLID-STATE CIRCUITS 1333 14.6
Micron Technology 2 IEEE TRANS ELECTRON DEVICES 1122 12.2
Micron Technology 3 J ELECTROCHEM SOC 601 6.6
Micron Technology 4 APPL PHYS LETT 571 6.2
Micron Technology 5 J APPL PHYS 448 4.9
Micron Technology 6 JPN J APPL PHYS 428 4.7
Micron Technology 7 IEEE ELECTRON DEV LETT 353 3.9
Micron Technology 8 MAT RES SOC SYMP PROC 263 2.9
Micron Technology 9 THIN SOLID FILMS 216 2.4
Micron Technology 10 IEICE TRANS ELECTRON 208 2.3
Micron Technology 11 PROC SOC PHOTO-OPT INSTR ENG 192 2.1
Micron Technology 12 J VAC SCI TECHNOL B 164 1.8
Micron Technology 13 IBM J RES DEVELOP 133 1.5
Micron Technology 14 IEEE SPECTRUM 106 1.2
Micron Technology 15 APPL SURF SCI 106 1.2
Micron Technology 16 SOLID STATE TECHNOL 94 1.0
Micron Technology 17 SEMICONDUCTOR INTERNATIONAL 93 1.0
Micron Technology 18 J VAC SCI TECHNOL A 91 1.0
Micron Technology 19 IEEE UNSPECIFIED 90 1.0
Micron Technology 20 J VAC SCI TECHNOL 86 0.9
Other IEEE Journals 377 4.1
Other non-IEEE Journals 2085 22.7
Total 9160 100.0
Total IEEE 3381 36.9
Total non-IEEE 5779 63.1

Tuesday, June 03, 2003 D-5

IEEE and Patents


Top Cited Journals of Top Information Technology Companies and Universities
(# Science References from 1983-2002 Patents to Journal Articles)
Company/University rank Journal #Science Refs Percent
MIT Information Technology Patents 1 APPL PHYS LETT 298 8.9
MIT Information Technology Patents 2 OPTICS LETTERS 122 3.6
MIT Information Technology Patents 3 ELECTRON LETT 116 3.4
MIT Information Technology Patents 4 J APPL PHYS 83 2.5
MIT Information Technology Patents 5 PROC IEEE 81 2.4
MIT Information Technology Patents 6 IEEE TRANS ELECTRON DEVICES 81 2.4
MIT Information Technology Patents 7 J ELECTROCHEM SOC 78 2.3
MIT Information Technology Patents 8 APPLIED OPTICS 71 2.1
MIT Information Technology Patents 9 PHYS REV LETT 64 1.9
MIT Information Technology Patents 10 IEEE J QUANTUM ELECTRON 57 1.7
MIT Information Technology Patents 11 COMMUN ACM 50 1.5
MIT Information Technology Patents 12 J CRYST GROWTH 49 1.5
MIT Information Technology Patents 13 MAT RES SOC SYMP PROC 49 1.5
MIT Information Technology Patents 14 IEEE PHOTONIC TECHNOL LETT 45 1.3
MIT Information Technology Patents 15 IEEE J SOLID-STATE CIRCUITS 44 1.3
MIT Information Technology Patents 16 JPN J APPL PHYS 44 1.3
MIT Information Technology Patents 17 IEEE TRANS ACOUST SPEECH SIGN 43 1.3
MIT Information Technology Patents 18 IEEE ELECTRON DEV LETT 43 1.3
MIT Information Technology Patents 19 SMPTE J-SOC MOT PIC TELE ENG 41 1.2
MIT Information Technology Patents 20 IEEE TRANS COMPUT 40 1.2
Other IEEE Journals 440 13.1
Other non-IEEE Journals 1424 42.4
Total 3363 100.0

Total IEEE 874 26.0


Total non-IEEE 2489 74.0

Company/University rank Journal #Science Refs Percent


Mitsubishi Electric 1 IEEE J SOLID-STATE CIRCUITS 634 12.2
Mitsubishi Electric 2 APPL PHYS LETT 405 7.8
Mitsubishi Electric 3 IEEE TRANS ELECTRON DEVICES 341 6.6
Mitsubishi Electric 4 JPN J APPL PHYS 219 4.2
Mitsubishi Electric 5 J APPL PHYS 177 3.4
Mitsubishi Electric 6 IEEE ELECTRON DEV LETT 173 3.3
Mitsubishi Electric 7 ELECTRON LETT 168 3.2
Mitsubishi Electric 8 J ELECTROCHEM SOC 132 2.5
Mitsubishi Electric 9 IEEE J QUANTUM ELECTRON 86 1.7
Mitsubishi Electric 10 IEEE TRANS CONSUM ELECTRON 84 1.6
Mitsubishi Electric 11 PROC IEEE 70 1.3
Mitsubishi Electric 12 J CRYST GROWTH 70 1.3
Mitsubishi Electric 13 SOLID STATE TECHNOL 69 1.3
Mitsubishi Electric 14 IEEE TRANS ON MAGNETICS 67 1.3
Mitsubishi Electric 15 IBM J RES DEVELOP 58 1.1
Mitsubishi Electric 16 ELECTRONICS 58 1.1
Mitsubishi Electric 17 J VAC SCI TECHNOL B 57 1.1
Mitsubishi Electric 18 IEEE TRANS COMPUT 48 0.9
Mitsubishi Electric 19 IEEE MICRO 44 0.8
Mitsubishi Electric 20 PROC SOC PHOTO-OPT INSTR ENG 44 0.8
Other IEEE Journals 571 11.0
Other non-IEEE Journals 1616 31.1
Total 5191 100.0
Total IEEE 2118 40.8
Total non-IEEE 3073 59.2

Tuesday, June 03, 2003 D-6

IEEE and Patents


Top Cited Journals of Top Information Technology Companies and Universities
(# Science References from 1983-2002 Patents to Journal Articles)
Company/University rank Journal #Science Refs Percent
Motorola 1 IEEE J SOLID-STATE CIRCUITS 336 4.9
Motorola 2 IEEE TRANS COMMUN 326 4.8
Motorola 3 APPL PHYS LETT 301 4.4
Motorola 4 J AMER CHEM SOC 268 3.9
Motorola 5 IEEE TRANS ELECTRON DEVICES 248 3.6
Motorola 6 IEEE TRANS COMPUT 194 2.8
Motorola 7 PROC IEEE 165 2.4
Motorola 8 J ELECTROCHEM SOC 154 2.3
Motorola 9 IEEE ELECTRON DEV LETT 141 2.1
Motorola 10 IEEE TRANS INFORM THEORY 141 2.1
Motorola 11 J APPL PHYS 132 1.9
Motorola 12 MAT RES SOC SYMP PROC 131 1.9
Motorola 13 IEEE TRANS ACOUST SPEECH SIGN 130 1.9
Motorola 14 ELECTRON LETT 130 1.9
Motorola 15 JPN J APPL PHYS 123 1.8
Motorola 16 IEEE J SEL AREA COMMUN 117 1.7
Motorola 17 SCIENCE 116 1.7
Motorola 18 ARTIF INTELL EXPERT 100 1.5
Motorola 19 IEEE TRANS MICROW THEORY TECH 90 1.3
Motorola 20 BELL SYST TECH J 85 1.2
Other IEEE Journals 874 12.8
Other non-IEEE Journals 2512 36.9
Total 6814 100.0

Total IEEE 2762 40.5


Total non-IEEE 4052 59.5

Company/University rank Journal #Science Refs Percent


NEC 1 APPL PHYS LETT 462 7.5
NEC 2 ELECTRON LETT 328 5.3
NEC 3 IEEE J SOLID-STATE CIRCUITS 274 4.4
NEC 4 JPN J APPL PHYS 234 3.8
NEC 5 J APPL PHYS 222 3.6
NEC 6 IEEE TRANS ELECTRON DEVICES 218 3.5
NEC 7 IEEE PHOTONIC TECHNOL LETT 162 2.6
NEC 8 IEEE TRANS ON MAGNETICS 141 2.3
NEC 9 J LIGHTWAVE TECHNOL 138 2.2
NEC 10 IEEE TRANS COMMUN 137 2.2
NEC 11 IEEE ELECTRON DEV LETT 134 2.2
NEC 12 PROC IEEE 110 1.8
NEC 13 J ELECTROCHEM SOC 103 1.7
NEC 14 IEEE TRANS COMPUT AID DES INT 101 1.6
NEC 15 IEEE J SEL AREA COMMUN 92 1.5
NEC 16 IEEE J QUANTUM ELECTRON 87 1.4
NEC 17 NATURE -INCLUDE LETT TO NAT 82 1.3
NEC 18 J CRYST GROWTH 77 1.2
NEC 19 APPLIED OPTICS 77 1.2
NEC 20 IEEE TRANS COMPUT 67 1.1
Other IEEE Journals 794 12.8
Other non-IEEE Journals 2132 34.6
Total 6172 100.0
Total IEEE 2317 37.5
Total non-IEEE 3855 62.5

Tuesday, June 03, 2003 D-7

IEEE and Patents


Top Cited Journals of Top Information Technology Companies and Universities
(# Science References from 1983-2002 Patents to Journal Articles)
Company/University rank Journal #Science Refs Percent
Siemens 1 IEEE TRANS ULTRASON FERROEL 374 4.3
Siemens 2 APPL PHYS LETT 337 3.9
Siemens 3 J ACOUST SOC AMER 325 3.8
Siemens 4 PROC IEEE 265 3.1
Siemens 5 ELECTRON LETT 257 3.0
Siemens 6 IEEE J SOLID-STATE CIRCUITS 219 2.5
Siemens 7 IEEE TRANS ELECTRON DEVICES 210 2.4
Siemens 8 ULTRASONIC IMAGING 201 2.3
Siemens 9 ULTRASOUND MEDICINE BIOL 165 1.9
Siemens 10 JPN J APPL PHYS 145 1.7
Siemens 11 J ULTRASOUND MED 133 1.5
Siemens 12 RADIOLOGY 133 1.5
Siemens 13 J ELECTROCHEM SOC 124 1.4
Siemens 14 J APPL PHYS 110 1.3
Siemens 15 APPLIED OPTICS 93 1.1
Siemens 16 IEEE TRANS ON MAGNETICS 90 1.0
Siemens 17 ACOUSTICAL IMAGING 88 1.0
Siemens 18 IEEE J QUANTUM ELECTRON 86 1.0
Siemens 19 IEEE ELECTRON DEV LETT 78 0.9
Siemens 20 SIEMENS FORSCH ENTWICKL 77 0.9
Other IEEE Journals 1126 13.1
Other non-IEEE Journals 3988 46.2
Total 8624 100.0

Total IEEE 2448 28.4


Total non-IEEE 6176 71.6

Company/University rank Journal #Science Refs Percent


Texas Instruments 1 IEEE TRANS ON MAGNETICS 860 12.4
Texas Instruments 2 IEEE J SOLID-STATE CIRCUITS 429 6.2
Texas Instruments 3 APPL PHYS LETT 404 5.8
Texas Instruments 4 IEEE TRANS ELECTRON DEVICES 333 4.8
Texas Instruments 5 J ELECTROCHEM SOC 307 4.4
Texas Instruments 6 J APPL PHYS 283 4.1
Texas Instruments 7 IEEE ELECTRON DEV LETT 203 2.9
Texas Instruments 8 PROC IEEE 166 2.4
Texas Instruments 9 MAT RES SOC SYMP PROC 159 2.3
Texas Instruments 10 ELECTRONICS 155 2.2
Texas Instruments 11 J VAC SCI TECHNOL B 152 2.2
Texas Instruments 12 J VAC SCI TECHNOL A 151 2.2
Texas Instruments 13 ELECTRONICS DESIGN 148 2.1
Texas Instruments 14 SOLID STATE TECHNOL 136 2.0
Texas Instruments 15 J VAC SCI TECHNOL 117 1.7
Texas Instruments 16 THIN SOLID FILMS 116 1.7
Texas Instruments 17 IEEE TRANS COMMUN 112 1.6
Texas Instruments 18 JPN J APPL PHYS 108 1.6
Texas Instruments 19 IEEE TRANS COMPUT 82 1.2
Texas Instruments 20 IEEE TRANS CONSUM ELECTRON 81 1.2
Other IEEE Journals 616 8.9
Other non-IEEE Journals 1807 26.1
Total 6925 100.0
Total IEEE 2882 41.6
Total non-IEEE 4043 58.4

Tuesday, June 03, 2003 D-8

IEEE and Patents


Top Cited Journals of Top Information Technology Companies and Universities
(# Science References from 1983-2002 Patents to Journal Articles)
Company/University rank Journal #Science Refs Percent
Toshiba 1 IEEE J SOLID-STATE CIRCUITS 523 8.1
Toshiba 2 APPL PHYS LETT 312 4.8
Toshiba 3 IEEE TRANS ELECTRON DEVICES 303 4.7
Toshiba 4 JPN J APPL PHYS 268 4.1
Toshiba 5 J APPL PHYS 253 3.9
Toshiba 6 J ELECTROCHEM SOC 171 2.6
Toshiba 7 IEEE TRANS ON MAGNETICS 154 2.4
Toshiba 8 ELECTRON LETT 123 1.9
Toshiba 9 IEEE ELECTRON DEV LETT 104 1.6
Toshiba 10 PROC IEEE 94 1.5
Toshiba 11 ELECTRONICS 92 1.4
Toshiba 12 IEEE TRANS CONSUM ELECTRON 91 1.4
Toshiba 13 MAGN RESON MED 90 1.4
Toshiba 14 PHYS REV LETT 90 1.4
Toshiba 15 J MAGN RESONANCE 72 1.1
Toshiba 16 J VAC SCI TECHNOL B 71 1.1
Toshiba 17 SOLID STATE TECHNOL 63 1.0
Toshiba 18 PHYS REV B-CONDENSED MATTER 58 0.9
Toshiba 19 J VAC SCI TECHNOL 58 0.9
Toshiba 20 THIN SOLID FILMS 56 0.9
Other IEEE Journals 806 12.4
Other non-IEEE Journals 2627 40.6
Total 6479 100.0

Total IEEE 2075 32.0


Total non-IEEE 4404 68.0

Company/University rank Journal #Science Refs Percent


U California Information Technology 1 APPL PHYS LETT 152 8.7
U California Information Technology 2 J APPL PHYS 80 4.6
U California Information Technology 3 SCIENCE 70 4.0
U California Information Technology 4 J AMER CHEM SOC 47 2.7
U California Information Technology 5 NATURE -INCLUDE LETT TO NAT 43 2.5
U California Information Technology 6 ELECTRON LETT 40 2.3
U California Information Technology 7 PHYS REV B-CONDENSED MATTER 39 2.2
U California Information Technology 8 PROC IEEE 33 1.9
U California Information Technology 9 PHYS REV LETT 33 1.9
U California Information Technology 10 REV SCI INSTR 28 1.6
U California Information Technology 11 JPN J APPL PHYS 28 1.6
U California Information Technology 12 IEEE TRANS ELECTRON DEVICES 27 1.6
U California Information Technology 13 IEEE ELECTRON DEV LETT 25 1.4
U California Information Technology 14 IEEE J QUANTUM ELECTRON 23 1.3
U California Information Technology 15 LANGMUIR 23 1.3
U California Information Technology 16 MAT RES SOC SYMP PROC 23 1.3
U California Information Technology 17 PHYSICA C 22 1.3
U California Information Technology 18 IEEE TRANS COMMUN 21 1.2
U California Information Technology 19 IEEE TRANS ACOUST SPEECH SIGN 21 1.2
U California Information Technology 20 J ELECTROCHEM SOC 21 1.2
Other IEEE Journals 191 10.9
Other non-IEEE Journals 751 43.2
Total 1741 100.0
Total IEEE 341 19.6
Total non-IEEE 1400 80.4

Tuesday, June 03, 2003 D-9

IEEE and Patents


Appendix E - Publishers Receiving most Refs from 1983-2002
Patents from Selected Information Technology Companies and
# Patent Percent of
Company/University Publisher Refs to total
AMD IEEE 1084 41.8
AMD CMP MEDIA 201 7.8
AMD unknown 147 5.7
AMD AMER INST PHYSICS 136 5.2
AMD ELECTROCHEMICAL SOC INC 126 4.9
AMD PENNWELL PUBL 102 3.9
AMD IBM CORP 88 3.4
AMD IEE 85 3.3
AMD ELSEVIER SCIENCE 74 2.9
AMD PENTON 71 2.7
AMD ASSOC COMPUTING MACHINERY 56 2.2
AMD A V S AMER INST PHYSICS 55 2.1
AMD MRS Materials Research Society 41 1.6
AMD INST PURE APPLIED PHYSICS 34 1.3
AMD REED BUSINESS INFORMATION/ELSEVIER 30 1.2
AMD MATERIALS RESEARCH SOCIETY 28 1.1
AMD PERGAMON-ELSEVIER 29 1.1
AMD AM VACUUM SOC, AM INST PHYSICS 27 1.0
43 others w/ less than 1% 177 6.8

# Patent Percent of
Company/University Publisher Refs to total
Canon AMER INST PHYSICS 1130 16.1
Canon IEEE 867 12.3
Canon unknown 804 11.4
Canon ELSEVIER SCIENCE 612 8.7
Canon INST PURE APPLIED PHYSICS 349 5.0
Canon AMER CHEMICAL SOC 232 3.3
Canon ELECTROCHEMICAL SOC INC 226 3.2
Canon ACADEMIC PRESS/ELSEVIER SCIENCE 200 2.8
Canon AMER SOC MICROBIOLOGY 174 2.5
Canon TAYLOR & FRANCIS 179 2.5
Canon IEE 152 2.2
Canon OPTICAL SOC AMER 158 2.2
Canon PERGAMON-ELSEVIER 145 2.1
Canon Russian Academy of Sciences 128 1.8
Canon AMERICAN PHYSICAL SOC 125 1.8
Canon Vacuum Society of Japan 121 1.7
Canon A V S AMER INST PHYSICS 123 1.7
Canon SPIE-INT SOCIETY OPTICAL ENGINEERING 78 1.1
Canon ASSOC COMPUTING MACHINERY 72 1.0
104 others w/ less than 1% 1159 16.5

Copyright (c) 2003, CHI Research, Inc.


Monday, July 07, 2003 E-1

IEEE and Patents


Appendix E - Publishers Receiving most Refs from 1983-2002
Patents from Selected Information Technology Companies and
# Patent Percent of
Company/University Publisher Refs to total
Fujitsu IEEE 1585 33.2
Fujitsu AMER INST PHYSICS 603 12.6
Fujitsu unknown 399 8.4
Fujitsu IEE 348 7.3
Fujitsu ELSEVIER SCIENCE 243 5.1
Fujitsu INST PURE APPLIED PHYSICS 245 5.1
Fujitsu OPTICAL SOC AMER 160 3.4
Fujitsu ELECTROCHEMICAL SOC INC 116 2.4
Fujitsu A V S AMER INST PHYSICS 104 2.2
Fujitsu ASSOC COMPUTING MACHINERY 85 1.8
Fujitsu PENNWELL PUBL 62 1.3
Fujitsu FUJITSU 53 1.1
Fujitsu IBM CORP 51 1.1
79 others w/ less than 1% 717 15.0

# Patent Percent of
Company/University Publisher Refs to total
Hitachi IEEE 1980 25.5
Hitachi unknown 935 12.1
Hitachi AMER INST PHYSICS 680 8.8
Hitachi ELSEVIER SCIENCE 454 5.9
Hitachi AMER CHEMICAL SOC 296 3.8
Hitachi INST PURE APPLIED PHYSICS 254 3.3
Hitachi IEE 226 2.9
Hitachi A V S AMER INST PHYSICS 202 2.6
Hitachi ASSOC COMPUTING MACHINERY 184 2.4
Hitachi AMERICAN PHYSICAL SOC 168 2.2
Hitachi ACADEMIC PRESS/ELSEVIER SCIENCE 155 2.0
Hitachi OPTICAL SOC AMER 121 1.6
Hitachi PENNWELL PUBL 110 1.4
Hitachi PERGAMON-ELSEVIER 103 1.3
Hitachi JOHN WILEY & SONS 97 1.3
Hitachi NATURE PUBLISHING GROUP 98 1.3
Hitachi IBM CORP 95 1.2
Hitachi AMER ASSOC ADVANCEMENT SCIENCE 85 1.1
136 others w/ less than 1% 1507 19.4

Copyright (c) 2003, CHI Research, Inc.


Monday, July 07, 2003 E-2

IEEE and Patents


Appendix E - Publishers Receiving most Refs from 1983-2002
Patents from Selected Information Technology Companies and
# Patent Percent of
Company/University Publisher Refs to total
HP IEEE 1947 27.6
HP unknown 784 11.1
HP ELSEVIER SCIENCE 528 7.5
HP ASSOC COMPUTING MACHINERY 512 7.3
HP Hewlitt Packard 407 5.8
HP AMER INST PHYSICS 350 5.0
HP AMER CHEMICAL SOC 228 3.2
HP IEE 211 3.0
HP IBM CORP 189 2.7
HP CMP MEDIA 172 2.4
HP OPTICAL SOC AMER 161 2.3
HP JOHN WILEY & SONS 121 1.7
HP PENNWELL PUBL 122 1.7
HP PENTON 86 1.2
HP SPIE-INT SOCIETY OPTICAL ENGINEERING 88 1.2
HP ELECTROCHEMICAL SOC INC 71 1.0
123 others w/ less than 1% 1069 15.2

# Patent Percent of
Company/University Publisher Refs to total
IBM IEEE 4660 29.2
IBM unknown 1906 11.9
IBM AMER INST PHYSICS 1526 9.6
IBM ASSOC COMPUTING MACHINERY 1039 6.5
IBM ELSEVIER SCIENCE 983 6.2
IBM IBM CORP 727 4.6
IBM AMERICAN PHYSICAL SOC 361 2.3
IBM A V S AMER INST PHYSICS 352 2.2
IBM ELECTROCHEMICAL SOC INC 345 2.2
IBM CMP MEDIA 264 1.7
IBM PERGAMON-ELSEVIER 254 1.6
IBM PENNWELL PUBL 224 1.4
IBM JOHN WILEY & SONS 219 1.4
IBM INST PURE APPLIED PHYSICS 231 1.4
IBM IEE 221 1.4
IBM AMER CHEMICAL SOC 225 1.4
IBM ACADEMIC PRESS/ELSEVIER SCIENCE 162 1.0
IBM SPIE-INT SOCIETY OPTICAL ENGINEERING 152 1.0
144 others w/ less than 1% 2109 13.2

Copyright (c) 2003, CHI Research, Inc.


Monday, July 07, 2003 E-3

IEEE and Patents


Appendix E - Publishers Receiving most Refs from 1983-2002
Patents from Selected Information Technology Companies and
# Patent Percent of
Company/University Publisher Refs to total
Intel IEEE 1232 52.4
Intel unknown 179 7.6
Intel ASSOC COMPUTING MACHINERY 117 5.0
Intel AMER INST PHYSICS 107 4.6
Intel ELECTROCHEMICAL SOC INC 96 4.1
Intel IEE 73 3.1
Intel ELSEVIER SCIENCE 71 3.0
Intel PENNWELL PUBL 65 2.8
Intel MRS Materials Research Society 33 1.4
Intel A V S AMER INST PHYSICS 30 1.3
Intel PENTON 27 1.1
Intel CMP MEDIA 26 1.1
43 others w/ less than 1% 294 12.5

# Patent Percent of
Company/University Publisher Refs to total
Lucent IEEE 5317 35.1
Lucent AMER INST PHYSICS 1798 11.9
Lucent IEE 1379 9.1
Lucent unknown 1120 7.4
Lucent OPTICAL SOC AMER 716 4.7
Lucent ELSEVIER SCIENCE 645 4.3
Lucent LUCENT TECHNOLOGIES 596 3.9
Lucent ASSOC COMPUTING MACHINERY 256 1.7
Lucent AMERICAN PHYSICAL SOC 250 1.7
Lucent A V S AMER INST PHYSICS 253 1.7
Lucent INST PURE APPLIED PHYSICS 241 1.6
Lucent ELECTROCHEMICAL SOC INC 224 1.5
Lucent AT&T 210 1.4
Lucent PERGAMON-ELSEVIER 179 1.2
133 others w/ less than 1% 1963 13.0

Copyright (c) 2003, CHI Research, Inc.


Monday, July 07, 2003 E-4

IEEE and Patents


Appendix E - Publishers Receiving most Refs from 1983-2002
Patents from Selected Information Technology Companies and
# Patent Percent of
Company/University Publisher Refs to total
Matsushita Electric IEEE 1487 28.4
Matsushita Electric AMER INST PHYSICS 603 11.5
Matsushita Electric unknown 566 10.8
Matsushita Electric ELSEVIER SCIENCE 483 9.2
Matsushita Electric INST PURE APPLIED PHYSICS 303 5.8
Matsushita Electric IEE 219 4.2
Matsushita Electric OPTICAL SOC AMER 145 2.8
Matsushita Electric SOC MOTION PICTURE TV ENGINEERS 110 2.1
Matsushita Electric AMER CHEMICAL SOC 96 1.8
Matsushita Electric PERGAMON-ELSEVIER 76 1.5
Matsushita Electric SPIE-INT SOCIETY OPTICAL ENGINEERING 77 1.5
Matsushita Electric ELECTROCHEMICAL SOC INC 76 1.5
Matsushita Electric AMERICAN PHYSICAL SOC 61 1.2
Matsushita Electric IECE 64 1.2
Matsushita Electric A V S AMER INST PHYSICS 56 1.1
Matsushita Electric ASSOC COMPUTING MACHINERY 52 1.0
97 others w/ less than 1% 764 14.6

# Patent Percent of
Company/University Publisher Refs to total
Micron Technology IEEE 3381 36.9
Micron Technology AMER INST PHYSICS 1043 11.4
Micron Technology ELSEVIER SCIENCE 745 8.1
Micron Technology ELECTROCHEMICAL SOC INC 601 6.6
Micron Technology unknown 504 5.5
Micron Technology INST PURE APPLIED PHYSICS 487 5.3
Micron Technology MRS Materials Research Society 263 2.9
Micron Technology A V S AMER INST PHYSICS 250 2.7
Micron Technology SPIE-INT SOCIETY OPTICAL ENGINEERING 221 2.4
Micron Technology IECE 220 2.4
Micron Technology IBM CORP 134 1.5
Micron Technology AMER CHEMICAL SOC 140 1.5
Micron Technology PENNWELL PUBL 99 1.1
Micron Technology PERGAMON-ELSEVIER 98 1.1
Micron Technology AM VACUUM SOC, AM INST PHYSICS 91 1.0
Micron Technology REED BUSINESS INFORMATION/ELSEVIER 93 1.0
61 others w/ less than 1% 790 8.6

Copyright (c) 2003, CHI Research, Inc.


Monday, July 07, 2003 E-5

IEEE and Patents


Appendix E - Publishers Receiving most Refs from 1983-2002
Patents from Selected Information Technology Companies and
# Patent Percent of
Company/University Publisher Refs to total
MIT Information Technology Patents IEEE 874 26.0
MIT Information Technology Patents AMER INST PHYSICS 407 12.1
MIT Information Technology Patents unknown 328 9.8
MIT Information Technology Patents ELSEVIER SCIENCE 225 6.7
MIT Information Technology Patents OPTICAL SOC AMER 208 6.2
MIT Information Technology Patents IEE 134 4.0
MIT Information Technology Patents AMERICAN PHYSICAL SOC 123 3.7
MIT Information Technology Patents ASSOC COMPUTING MACHINERY 118 3.5
MIT Information Technology Patents ELECTROCHEMICAL SOC INC 78 2.3
MIT Information Technology Patents PERGAMON-ELSEVIER 69 2.1
MIT Information Technology Patents A V S AMER INST PHYSICS 61 1.8
MIT Information Technology Patents AMER CHEMICAL SOC 60 1.8
MIT Information Technology Patents INST PURE APPLIED PHYSICS 53 1.6
MIT Information Technology Patents SPIE-INT SOCIETY OPTICAL ENGINEERING 50 1.5
MIT Information Technology Patents MRS Materials Research Society 49 1.5
MIT Information Technology Patents SOC MOTION PICTURE TV ENGINEERS 41 1.2
MIT Information Technology Patents AMER ASSOC ADVANCEMENT SCIENCE 35 1.0
93 others w/ less than 1% 450 13.4

# Patent Percent of
Company/University Publisher Refs to total
Mitsubishi Electric IEEE 2118 40.8
Mitsubishi Electric AMER INST PHYSICS 620 11.9
Mitsubishi Electric unknown 421 8.1
Mitsubishi Electric ELSEVIER SCIENCE 261 5.0
Mitsubishi Electric INST PURE APPLIED PHYSICS 250 4.8
Mitsubishi Electric IEE 245 4.7
Mitsubishi Electric ELECTROCHEMICAL SOC INC 132 2.5
Mitsubishi Electric A V S AMER INST PHYSICS 96 1.8
Mitsubishi Electric PENNWELL PUBL 85 1.6
Mitsubishi Electric PERGAMON-ELSEVIER 72 1.4
Mitsubishi Electric IBM CORP 59 1.1
Mitsubishi Electric OPTICAL SOC AMER 52 1.0
Mitsubishi Electric SPIE-INT SOCIETY OPTICAL ENGINEERING 54 1.0
88 others w/ less than 1% 726 14.0

Copyright (c) 2003, CHI Research, Inc.


Monday, July 07, 2003 E-6

IEEE and Patents


Appendix E - Publishers Receiving most Refs from 1983-2002
Patents from Selected Information Technology Companies and
# Patent Percent of
Company/University Publisher Refs to total
Motorola IEEE 2762 40.5
Motorola AMER CHEMICAL SOC 590 8.7
Motorola unknown 433 6.4
Motorola AMER INST PHYSICS 437 6.4
Motorola ELSEVIER SCIENCE 385 5.7
Motorola IEE 231 3.4
Motorola ELECTROCHEMICAL SOC INC 154 2.3
Motorola INST PURE APPLIED PHYSICS 134 2.0
Motorola MRS Materials Research Society 131 1.9
Motorola PERGAMON-ELSEVIER 129 1.9
Motorola AMER ASSOC ADVANCEMENT SCIENCE 116 1.7
Motorola A V S AMER INST PHYSICS 111 1.6
Motorola MILLER FREEMAN 100 1.5
Motorola LUCENT TECHNOLOGIES 92 1.4
Motorola OXFORD UNIV PRESS 68 1.0
95 others w/ less than 1% 941 13.8

# Patent Percent of
Company/University Publisher Refs to total
NEC IEEE 2317 37.5
NEC AMER INST PHYSICS 712 11.5
NEC IEE 390 6.3
NEC unknown 383 6.2
NEC INST PURE APPLIED PHYSICS 272 4.4
NEC ELSEVIER SCIENCE 259 4.2
NEC IECE 149 2.4
NEC OPTICAL SOC AMER 140 2.3
NEC AMERICAN PHYSICAL SOC 123 2.0
NEC A V S AMER INST PHYSICS 114 1.8
NEC ELECTROCHEMICAL SOC INC 103 1.7
NEC NATURE PUBLISHING GROUP 84 1.4
NEC ASSOC COMPUTING MACHINERY 79 1.3
NEC PERGAMON-ELSEVIER 83 1.3
NEC AMER CHEMICAL SOC 66 1.1
NEC SPIE-INT SOCIETY OPTICAL ENGINEERING 62 1.0
85 others w/ less than 1% 836 13.5

Copyright (c) 2003, CHI Research, Inc.


Monday, July 07, 2003 E-7

IEEE and Patents


Appendix E - Publishers Receiving most Refs from 1983-2002
Patents from Selected Information Technology Companies and
# Patent Percent of
Company/University Publisher Refs to total
Siemens IEEE 2448 28.4
Siemens unknown 1401 16.2
Siemens ELSEVIER SCIENCE 658 7.6
Siemens AMER INST PHYSICS 516 6.0
Siemens IEE 366 4.2
Siemens ACOUSTICAL SOC AMER AMER INST PHYSIC 325 3.8
Siemens DYNAMEDIA 201 2.3
Siemens INST PURE APPLIED PHYSICS 160 1.9
Siemens OPTICAL SOC AMER 146 1.7
Siemens RADIOLOGICAL SOC NORTH AMERICA 133 1.5
Siemens AMER INST ULTRASOUND MEDICINE 133 1.5
Siemens ELECTROCHEMICAL SOC INC 124 1.4
Siemens SIEMENS 105 1.2
Siemens IOP PUBLISHING LTD 99 1.1
Siemens A V S AMER INST PHYSICS 96 1.1
Siemens PERGAMON-ELSEVIER 89 1.0
Siemens JOHN WILEY & SONS 89 1.0
138 others w/ less than 1% 1535 17.8

# Patent Percent of
Company/University Publisher Refs to total
Texas Instruments IEEE 2882 41.6
Texas Instruments AMER INST PHYSICS 706 10.2
Texas Instruments unknown 508 7.3
Texas Instruments ELSEVIER SCIENCE 311 4.5
Texas Instruments ELECTROCHEMICAL SOC INC 307 4.4
Texas Instruments A V S AMER INST PHYSICS 269 3.9
Texas Instruments IEE 217 3.1
Texas Instruments PENNWELL PUBL 185 2.7
Texas Instruments MRS Materials Research Society 159 2.3
Texas Instruments AM VACUUM SOC, AM INST PHYSICS 151 2.2
Texas Instruments PENTON 148 2.1
Texas Instruments INST PURE APPLIED PHYSICS 116 1.7
Texas Instruments OPTICAL SOC AMER 113 1.6
Texas Instruments PERGAMON-ELSEVIER 89 1.3
Texas Instruments SPIE-INT SOCIETY OPTICAL ENGINEERING 82 1.2
Texas Instruments TAYLOR & FRANCIS 78 1.1
72 others w/ less than 1% 604 8.7

Copyright (c) 2003, CHI Research, Inc.


Monday, July 07, 2003 E-8

IEEE and Patents


Appendix E - Publishers Receiving most Refs from 1983-2002
Patents from Selected Information Technology Companies and
# Patent Percent of
Company/University Publisher Refs to total
Toshiba IEEE 2075 32.0
Toshiba AMER INST PHYSICS 610 9.4
Toshiba unknown 590 9.1
Toshiba ELSEVIER SCIENCE 370 5.7
Toshiba INST PURE APPLIED PHYSICS 288 4.4
Toshiba IEE 247 3.8
Toshiba AMERICAN PHYSICAL SOC 174 2.7
Toshiba ELECTROCHEMICAL SOC INC 171 2.6
Toshiba A V S AMER INST PHYSICS 129 2.0
Toshiba JOHN WILEY & SONS 126 1.9
Toshiba PERGAMON-ELSEVIER 101 1.6
Toshiba ACADEMIC PRESS/ELSEVIER SCIENCE 105 1.6
Toshiba PENNWELL PUBL 88 1.4
Toshiba ASSOC COMPUTING MACHINERY 87 1.3
Toshiba AMER CHEMICAL SOC 65 1.0
Toshiba OPTICAL SOC AMER 68 1.0
124 others w/ less than 1% 1185 18.3

# Patent Percent of
Company/University Publisher Refs to total
U California Information Technology IEEE 341 19.6
U California Information Technology AMER INST PHYSICS 272 15.6
U California Information Technology ELSEVIER SCIENCE 166 9.5
U California Information Technology AMER CHEMICAL SOC 136 7.8
U California Information Technology unknown 102 5.9
U California Information Technology AMERICAN PHYSICAL SOC 89 5.1
U California Information Technology AMER ASSOC ADVANCEMENT SCIENCE 70 4.0
U California Information Technology NATURE PUBLISHING GROUP 50 2.9
U California Information Technology OPTICAL SOC AMER 46 2.6
U California Information Technology IEE 44 2.5
U California Information Technology INST PURE APPLIED PHYSICS 37 2.1
U California Information Technology IOP PUBLISHING LTD 29 1.7
U California Information Technology ACADEMIC PRESS/ELSEVIER SCIENCE 30 1.7
U California Information Technology PERGAMON-ELSEVIER 27 1.6
U California Information Technology MRS Materials Research Society 23 1.3
U California Information Technology ELECTROCHEMICAL SOC INC 21 1.2
U California Information Technology A V S AMER INST PHYSICS 18 1.0
62 others w/ less than 1% 240 13.8

Copyright (c) 2003, CHI Research, Inc.


Monday, July 07, 2003 E-9

IEEE and Patents


More Measures of the Value of IEEE Information - Patents Are Just the Beginning

IEEE Journals Continue to Dominate Annual Citation Study Ranking

IEEE publishes the top eight journals in electrical and electronics engineering and the top seven journals
in telecommunications, as well as the number-one journals in many other fields, according to results
from the Institute for Scientific Information’s annual Journal Citation Reports. www.ieee.org/citations.

IEEE Journals Priced 39% Below Market Average

The annual IEEE Journal Pricing study finds that IEEE magazines, transactions, journals and letters
continue to be priced significantly lower than those of similar publishers. Based on a statistically aver-
age 500-page journal, the results show that the average price of an electrical engineering or computer
science publication was US$644, while the average price of an IEEE periodical was US$391. IEEE
outperformed by providing journals priced 39% less than the market average.

Library Journal Report Underscores Value of IEEE Journals

A study published in Library Journal finds that IEEE publications are priced well below market value.
The Library Journal report compared scientific periodicals solely on price, finding that the average
price of an engineering publication in 2004 is $1,491, with computer science publications averaging at
$1,171. The average unequalized price of an IEEE periodical in 2004 is just $509.

Record Number of IEEE Documents Downloaded in 2003

Users of IEEE technical information downloaded a record 43.7 million full-text PDFs from the IEEE
Xplore delivery system in 2003 – an increase of 88.7% over downloads in 2002.

If your company had instant access to IEEE online publications, how much more could you accomplish?
www.ieee.org/discover.

CHI Research, Inc. IEEE


10 White Horse Pike 445 Hoes Lane
Haddon Heights, NJ 08035 USA P.O. Box 1331
Phone: +1 856 546 0600 Piscataway, NJ 08855 USA
Fax: +1 856 546 9633 Phone: +1 800 701 4333 (U.S.and Canada)
email: info@chiresearch.com Phone: +1 732 981 0060 (worldwide)
Email: onlineproducts@ieee.org

IEEE and Patents

You might also like