Research evaluation is now led by the data rather than by judgement. Metrics have proliferated: usually well intentioned, not always well informed, often ill applied. There is the risk to damage the system with the tools designed to improve it, as evaluation is increasingly implemented by organizations without knowledge of, or advice on, good practice and interpretation.
To support researchers, a team of five experts, led by Diana Hicks, the professor of political science at the University of Georgia and Paul Wouters, the director of Science and Technology Studies Center of Leiden University presented the Leiden manifesto, where proposed a set of guiding principles on the use of quantitative metrics in research assessment.
The ten principles of the Leiden Manifesto:
- Quantitative evaluation should support qualitative, expert assessment
- Measure performance against the research missions of the institution, group or researcher,
- Protect excellence in locally relevant research
- Keep data collection and analytical processes open, transparent and simple
- Allow those evaluated to verify data and analysis
- Account for variation by field in publication and citation practices
- Base assessment of individual researchers on a qualitative judgement of their portfolio.
- Avoid misplaced concreteness and false precision
- Recognise the systemic effects of assessment and indicators
- Scrutinize indicators regularly and update them.
Read more about Leiden Manifesto for Research Metrics
Prepared by the Scientific Information Data Department (SIDD).