While good, ICMR impact scale may deter research in public interest

The Indian Council of Medical Research (ICMR) lately proposed the Impact of Research and Innovation Scale (IRIS), a scale with which to measure the impactfulness of the consequences of biomedical, public well being, and allied research initiatives funded by the organisation. ICMR is India’s topmost governmental grants-giving and research agenda-setting physique vis-à-vis well being research, so the scale and its calculi will probably be of nice consequence to the Indian medical and well being research communities.

ICMR proposes to measure research impact in items known as publication-equivalents (PEs). A research paper revealed in a peer-reviewed journal that experiences outcomes or strategies of major research, or a scientific overview and meta-analysis is assigned 1 PE — whereas a research paper that’s cited in insurance policies/tips is assigned 10 PEs. A patent’s impact is 5 PEs and that of a industrial machine getting used at scale is 20 PEs.

Pros of standardisation

There are a number of benefits to measuring research impact in this manner. First, utilizing PEs because the ‘unit of impact’ supplies a standardised body of reference to debate completely different sorts of impact. It will permit ICMR to evaluate the impact of heterogenous work from researchers throughout disciplines, akin to biochemistry, physiology, biomedical engineering, public well being, and so forth., working at completely different scales, together with primary science, translational sciences, inhabitants public well being sciences, and so forth.

Second, IRIS recognises that there’s extra to research impact than citations. Medical and well being researchers, significantly these working in tutorial setups, sometimes lack incentives to pursue research that wouldn’t result in citable tutorial papers. But a scale like IRIS may break that construction and incentivise researchers to diversify students’ research portfolio. Third, tying PEs and IRIS to precise selections about funding allocation and undertaking prioritisation ensures it gained’t be a theoretical,  tutorial train. That ICMR is piloting IRIS to measure the impact of present research grant programmes and institutes is a crucial sign of motion.

Skewing research analysis

For the identical causes, it’s essential to look at the place and the way this comparatively easy strategy to standardising research analysis may fail. First, a sound theoretical rationale is lacking for PEs as a unit of research impact the way in which the ICMR will wield it. The ICMR word states that commentary, perspective, and narratives overview papers could have 0 PE. In this case, the 1977 paper that launched the biopsychosocial mannequin of medication, which reworked medical and public well being research, could have no impact. Articulating new concepts and significant discourse round rising proof are on the basis of research and are evidently impactful, but the PE-based system may discourage Indian researchers from pursuing articles of this nature.

Second, IRIS can skew how sure research is valued over another. Research that results in coverage adjustments receives 10 PEs whereas industrial gadgets obtain 20 PEs. As a consequence, the RATIONS medical trial that studied vitamin in tuberculosis sufferers and India’s Home-Based Neonatal Care that revolutionised neighborhood well being programming will probably be deemed to be much less impactful than, say, a commercialised robotic surgical procedure machine. This outlook may discourage primary science and tutorial drugs and coerce researchers and establishments to commercialise their research and improvements.

While it’s their prerogative to take action, there’s a hazard of this taking place on the expense of the ethos of scientific research as a public good. The deserves of latest proposals are contingent on the native context. Biomedical and well being research in India are identified to have suffered from a poor research ethics tradition, and there’s a threat this might increase to have an effect on PEs as properly. It is thus important that our public sector establishments maintain the road and stand with the ethos of ‘research as a public good’.

Finally, a unit and scale that can decide the destiny of biomedical and well being research in India ought to be developed following rigorous research requirements, with full transparency and mechanisms for accountability. The ICMR word mentions an ongoing pilot throughout its establishments and optimistic suggestions, but it surely ought to observe well-established examine design and evaluation strategies to develop such scales. For occasion, the project of PEs to completely different indicators might be completed by means of a national-level Delphi examine the place researchers kind a consensus on the project. Data should be shared with unbiased teams to analyse and validate the scale.

Measuring research impact is a sophisticated train with no appropriate solutions. Institutions such because the ICMR have the chance and the duty to resolve it creatively and collaboratively.

Siddhesh Zadey is a co-founder of the nonprofit Association for Socially Applicable Research (ASAR) and a doctoral scholar in epidemiology at Columbia University.