"Citation Analyses" and "Impact Factors" are terms often encountered in connection with the evaluation of research. Unfortunately, their correct application and interpretation is not as simple as it may seem. Given their potential influence on far-reaching decisions, including the careers of individuals, it is imperative to be aware of and to avoid possible pitfalls when compiling and presenting such data. We strongly recommend turning to the IVS-BM or IVS-CPT staff for professional advice or assistance. See "Bibliometric Analyses" or contact us.
Following is a collection of comments, examples, presentations, publications and other information material that may be useful to those who wish to know more about these often misused and highly controversial performance indicators:
- What you need to know about the Web of Science (PDF)
Presentation slides by Werner Marx & Hermann Schier, IVS-CPT, adapted & extended by Benjamin F. Bowman, IVS-BM, June 2009.
- Bibliometrie in der Forschungsevaluierung (PDF)
Presentation slides by Benjamin F. Bowman & Werner Marx, June 2009.
- Forschungsbewertung auf der Basis von Zitierungen - Aussagekraft und Grenzen der Methode
By W. Marx, IVS-CPT, in: Publikationsverhalten in unterschiedlichen wissenschaftlichen Disziplinen - Beiträge zur Beurteilung von Forschungsleistungen (PDF), Diskussionspapiere der Alexander von Humboldt-Stiftung, 2009, pp. 132-155.
- Stellungnahme der IVSn zum "Gesamt Impact" (PDF)
November 2008
- Bibliometrie in der Forschungsevaluierung (PDF)
Presentation at the AgFN ("Arbeitsgruppe Fachreferat Naturwissenschaften") Meeting in Berlin, September 2007 
- Der Hirsch-Index (PDF)
Ein neuer zitierungsbasierter Indikator, der auf die Bewertung von einzelnen Wissenschaftlern abzielt. Der Hirsch-Index misst nicht den einzelnen "Impact", sondern vielmehr die Breite der hoch zitierten Arbeiten.
-
Selected publications dealing with Impact Factor misuse:
- R. Adler, J. Ewing, P. Taylor / Joint Committee on Quantitative Assessment of Research: Citation Statistics - A report from the International Mathematical Union (IMU) in cooperation with the International Council of Industrial and Applied Mathematics (ICIAM) and the Institute of Mathematical Statistics (IMS), 12 June 2008 (PDF)
- E. Garfield: The History and Meaning of the Journal Impact Factor, JAMA, Vol.295 (1), 90-93 (4 January 2006)
doi:10.1001/jama.295.1.90
- P. Dong, M. Loh, A. Mondry: The "impact factor" revisited, The Biomedical Digital Libraries 2005, Vol.2 (7) doi:10.1186/1742-5581-2-7
- [Editorial], Not-so-deep impact, Nature, Vol.435, 1003-1004 (23 June 2005) doi:10.1038/4351003a
- D. Colquhoun: Challenging the tyranny of impact factors, Nature, Vol.423, 479 (29 May 2003) doi:10.1038/423479a
- D. Adam: The counting house, Nature, Vol.415, 726-729 (14 February 2002) doi:10.1038/415726a
- H.F. Moed: The impact-factors debate: the ISI´s uses and limits, Nature, Vol.415, 731-732 (14 February 2002) doi:10.1038/415731a
- [Editorial], Citation data: the wrong impact?, Nature Neuroscience, Vol.1 (8), 641-642 (December 1998) doi:10.1038/3639
- P.O. Seglen: Why the Impact Factor of journals should not be used for evaluating research, British Medical Journal, Vol.314, 497-502 (15 February 1997) PMID:9056804
- Impact factors cannot replace citation analysis! (PDF)
Contribution to a discussion on the problems of using the journal impact factors for research evaluation. By B. Bowman, IVS-BM, and W. Marx, IVS-CPT, August 2005.
- Missbrauch des "Impact Factor" in der Forschungsevaluierung (PDF)
The misuse of the Journal Impact Factor for research evaluation purposes - in particular at German universities. Statement prepared for a DFG committee by B.Bowman, IVS-BM, November 2003.
- Journal Impact Factors - Vorsicht beim Gebrauch! (PDF)
Caution must be taken when using Journal Impact Factors. An article by W. Marx, IVS-CPT, May 2002.
- Zitierungsanalysen für die Forschungsevaluation
Recommendations regarding the application of citation analyses for research evaluation purposes (in German). Joint position paper by information managers of the MPS, May 1997.
-
The ISI Journal Citation Reports (JCR)
The two editions of the JCR provide citation data (e.g. Journal Impact Factors) for nearly 5.000 science and 1,700 social sciences journals. It may be used for journal evaluation and selection - not for research evaluation.
The following ISI websites provide additional information:
Please consider our environment - do you really need to print this page?
rss
Top
Print