Skip to main content

Managing routinely collected NHS data for research

Health research using routinely collected National Health Service (NHS) data derived from electronic health records (EHRs) and health service information systems has been growing in both importance and quantity. Wide population coverage and detailed patient-level information allow this data to be applied to a variety of research questions.

The sensitivity, complexity and scale of such data also hamper researchers from fully exploiting this potential. In an article published in the journal Informatics in Primary Care, Vasa Curcin and colleagues examine the current challenges preventing researchers from making optimal use of the data sets at their disposal, on both the legislative and practical levels, and give recommendations as to how these challenges can be overcome.

Several projects have recently been launched in the UK to address poor research data-management practices. Rapid Organisation of Healthcare Research Data (ROHRD) at Imperial College, London produced a useful prototype that provides local researchers with a one-stop index of available data sets together with relevant metadata. Curcin and colleagues reported that increased transparency of data sets' availability and their provenance leads to better utilisation and facilitates compliance with regulatory requirements.

They concluded that research data resulting from NHS data is often not utilised fully, or is handled in a haphazard manner that prevents full auditability of the research. Furthermore, lack of informatics and data management skills in research teams act as a barrier to implementing more advanced practices, such as provenance capture and detailed, regularly updated, data management strategies.

Comments

Popular posts from this blog

What is the difference between primordial prevention and primary prevention?

Primordial prevention and primary prevention are both crucial strategies for promoting health, but they operate at different levels. Primordial prevention aims to address the root causes of health problems and improve the wider determinants of health. It focuses on preventing the emergence of risk factors in the first place by tackling the underlying social, economic, and environmental determinants of health. This involves broad, population-wide interventions such as: Policies that promote healthy food choices: Think about initiatives like taxing sugary drinks to discourage unhealthy consumption, or providing subsidies for fruits and vegetables to make them more accessible. Urban planning that prioritises well-being: This could include creating walkable neighborhoods with safe cycling routes, ensuring access to green spaces for recreation and relaxation, and designing communities that foster social connections. Social programs that address inequality: Initiatives aimed at reducing pov...

What makes a good doctor – and who gets to decide?

What Makes a Good Doctor? This is the question that Waseem Jerjes and I explore in the Journal of the Royal Society of Medicine . It is a key question that underpins the architecture of medical education, clinical practice, regulation, and professional identity. It cannot be answered by regulators, educators, or employers in isolation. It must be answered together – by doctors and patients – revisited throughout a career, and adapted as society and the profession change. Without that shared reflection, the danger is not simply disillusionment, but the erosion of the moral foundations of clinical work. As we enter an era when diagnosis will increasingly involve artificial intelligence and when performance metrics reward volume over value, reclaiming this question as a professional one is imperative. The integrity of our institutions – and of the practitioners within them – depends on reimagining excellence in inclusive, relational terms. A good doctor is not a flawless technician or a f...

Relevance Over Recall: Rethinking How AI Uses Clinical Data

Our article in the Journal of the Royal Society of Medicine argues that safe and effective AI in healthcare must incorporate mechanisms that emulate human judgement - down-weighting old, inaccurate or superseded information and prioritising what is recent, clinically relevant and reaffirmed - so that AI supports, rather than disrupts, high-quality patient care.  Clinicians constantly revise, reinterpret and filter past information so that only what is relevant, accurate and timely shapes present-day management decisions; medical records function as dynamic “working tools” rather than fixed archives. By contrast, many AI systems lack this capacity for selective forgetting and often treat all historical data as equally meaningful.  This can lead to outdated or low-confidence diagnoses being repeatedly resurfaced, persistent labels influencing clinical expectations, and irrelevant, long-resolved events cluttering summaries and decision-support outputs. Such indiscriminate recall...