HDR UK Gateway
HDR Gateway logo

Bookmarks

Using LLMs to generate hospital discharge summaries: a feasibility study

Safe People

Organisation name

Imperial College London

Organisation sector

Academic Institute

Applicant name(s)

Erik Mayer

Funders/ Sponsors

Tim Orchard

DEA accredited researcher?

Unknown

Sub-licence arrangements (if any)?

No

Safe Projects

Project ID

NIBDAPC_2024_0031

Lay summary

A discharge summary (also called a ‘discharge letter’) provides a summary of a patient’s hospital stay and includes key information such as why the patient was admitted to hospital, and tests and treatments received; it also includes instructions for GPs about ongoing care the patient needs (for example, stitches to be removed, medications to be started or stopped). Discharge summaries are usually written by junior doctors who work under extreme pressure. The discharge summary can be time-consuming to write and it is very difficult for doctors find time to do this administrative task whilst also seeing and treating patients who are ill in hospital. But patients can experience delays in their discharge or problems with their care after they leave the hospital if the discharge summary contains errors. This project will explore whether ChatGPT has the potential to help junior doctors to produce high-quality discharge summaries. Microsoft ChatGPT is a special type of artificial intelligence (AI) application that can generate and summarise human-like text based on information it is presented with. We want to understand whether ChatGPT can generate discharge summaries when presented with documents from the patient’s hospital record (including, for example, ward round notes, operation notes, test results). This project will not use the publicly available version of ChatGPT; a special version will be installed in the iCARE secure data environment. The iCARE secure data environment is a secure platform that holds patient data which has been de-identified (names and personal details removed) for research and audit purposes. Individual patients cannot be identified from the data and the iCARE environment can only be accessed by researchers who have received approval to do so. Patient data is not shared with Microsoft. Junior doctors on the project team will create text ‘prompts’ – instructions that tell ChatGPT what to do, for example: “You are doctor responsible for looking after hospital inpatients. Write a discharge summary including the following information […].” The prompts will also tell ChatGPT what NOT to do to ensure it doesn’t produce any false information, for example:“Generate the patient discharge summary based solely on the information documented in the patients’ notes.” We will do a study to assess whether Chat-GPT can generate discharge summaries that are as good as the ones written by junior doctors. If the results of this study are positive, we will do further research to understand how ChatGPT could improve on the discharge summaries written by junior doctors, for example, by tailoring them to different audiences (patients, carers, GPs, care homes, languages other than English) and by using recognised standards for discharge summaries (published by the Professional Records Standards Body – an organisation that makes recommendations about documentation in patients’ medical records).

Public benefit statement

This project is an initial steps towards patient benefitting patients. Assuming this project shows that ChatGPT can produce discharge summaries of the same quality as those written by junior doctors, implementation of the technology at Imperial College Healthcare NHS Trust (and beyond) could lead to to the following benefits: • reduced delays for patients waiting to be discharged from hospital • time usually spent writing discharge summaries could be released back to clinicians to spend directly assessing/treating patients or communicating with them face-to-face about their discharge • patients, carers and primary care practitioners having an improved understanding of discharge instructions from the acute setting thereby improving care continuity and minimising the risk of errors (e.g. patients taking their medications incorrectly or missing an important follow-up appointment).

Request category type

Public Health Research

Other approval committees

Project start date

03/05/2024

Latest approval date

06/02/2024

Safe Data

Dataset(s) name

ICHT ChatGPT iCARE Data Model

Data sensitivity level

De-Personalised

Common Law Duty of Confidentiality

Not applicable

National data opt-out applied?

Not applicable

Request frequency

One-off

Release/Access date

18/09/2025

Safe Setting

Access type

TRE

Safe Outputs

Link to research outputs