Unlocking a national adult cardiac surgery audit registry with The R - - PowerPoint PPT Presentation

unlocking a national adult cardiac
SMART_READER_LITE
LIVE PREVIEW

Unlocking a national adult cardiac surgery audit registry with The R - - PowerPoint PPT Presentation

Unlocking a national adult cardiac surgery audit registry with The R User Conference 2013 University of Castilla-La Mancha, Albacete, Spain GL Hickey 1,2,3 , SW Grant 2,3 & B Bridgewater 1,2,3 1 Northwest Institute of BioHealth Informatics,


slide-1
SLIDE 1

Unlocking a national adult cardiac surgery audit registry with

GL Hickey1,2,3, SW Grant2,3 & B Bridgewater1,2,3

1Northwest Institute of BioHealth Informatics, University of Manchester 2University Hospital of South Manchester 3National Institute of Cardiovascular Outcomes Research, UCL

The R User Conference 2013 University of Castilla-La Mancha, Albacete, Spain

slide-2
SLIDE 2

BACKGROUND

slide-3
SLIDE 3

Bristol Inquiry

Contributory factors that led to the failings included:

  • 1. Inadequate

collection of data

  • 2. Inadequate

monitoring of data

slide-4
SLIDE 4

National Adult Cardiac Surgery Audit registry

  • Up to 166 clinical variables collected on each

patient: administrative, demographics, comorbidities, operative factors, outcomes

  • 15 years of data
  • 465,000 records
  • 44 hospitals + >400 consultant surgeons
slide-5
SLIDE 5

Flow of data

NICOR NIBHI

HOSPITALS

DATABASE CLEANING ANALYSES

AUDIT & GOVERNANCE TOOLS

CLINICAL RESEARCHERS

NATIONAL DEATH REGISTER*

* Ability to link with many

  • ther national registries

RESEARCH

slide-6
SLIDE 6

UNLOCKING THE REGISTRY

MESSY DATA

slide-7
SLIDE 7

Cleaning the registry in

DATA EXTRACT VARIABLE 1 VARIABLE 2 VARIABLE 3 ………… EXCLUDE RECORDS ADD VALUE CLEANE D DATA Scripts to add:

  • Risk scores
  • Combined variables
  • ‘Resolve’ conflicting

variables

  • Script per each variable
  • Some dependencies

E.g. duplicates Rapidly reproducible

slide-8
SLIDE 8

> with(SCTS, table(X4.04.Discharge.Destination, X4.05.Status.at.Discharge)) X4.05.Status.at.Discharge X4.04.Discharge.Destination 0. Alive 1. Dead 828 48296 2453 . Another dept within the trust 0 57 0 0 1 1 0

  • 0. Not applicable - patient deceased 0 0 1

1 Home 0 4104 0

  • 1. Home 674 370763 374

2 Convalescence 0 63 0

  • 2. Convalescence 8 7347 4
  • 2. Convalescence (Non acute Hospital) 2 2164 0

3 Other hospital 0 1 0 3 Other Hospital 0 151 0 3 Other Hospital - wd 6 0 1 0 3 Other Hospital wd 2 0 1 0 3 Other ward 0 1 0

  • 3. Other Acute hospital 1 7680 1
  • 3. Other hospital 115 22935 37

4 Patient deceased 0 0 173

  • 4. Not applicable - patient deceased 51 412 13286
  • 4. Patient Deceased 0 0 19

5 0 7 0

  • 5. Transferred to different Consultant - NGH 0 42 0

7 0 2 0 8 0 38 4 9 114 3820 518 Second op 0 2 6

Illegal options Transcriptional discrepancies Missing data Conflicts

slide-9
SLIDE 9
  • Errors are difficult to find and not all can be

resolved

  • Excluding all imperfect data not an option
  • Balance between a ‘research ready’ dataset and

robust audit capability

  • Needs to be reproducible
  • It is locked to clinicians & researchers without

being cleaned

Cleaning the registry in

slide-10
SLIDE 10

Warning: cleaning clinical registries without experts is dangerous*

* Applies to analysing healthcare data also

+ =

DATA

slide-11
SLIDE 11

UNLOCKING THE REGISTRY

MONITORING

slide-12
SLIDE 12
  • 0%

5% 10% 15%

Mortality rate

  • RAMR

200 400 600 800

f procedures

Healthcare provider

  • 2386780

2503756 3166114 3207776 3226274 3286898 3451180 3631845 4445638 4473204 4683551

Publication of named healthcare provider outcomes

http://www.scts.org/patients/

slide-13
SLIDE 13

Publication of named healthcare provider outcomes

FILTER DATA

subset

RISK ADJUSTMENT

glm, glmer {lme4}, mfp {mfp}, predict, auc {pROC},

CLASSIFICATION & PRESENTATION

ggplot {ggplot2}, write.csv

AGGREGATION

summaryBy {doBy}, merge, arrange {plyr}

slide-14
SLIDE 14

Exploratory analyses

http://www.scts.org/DynamicCharts/

summaryBy {doBy} + gvisMotionChart {googleVis}

slide-15
SLIDE 15

Monitoring medical devices

  • Currently does not

happen in UK

  • Data: 200 valve types

entered 13,000 ways (free text)

  • But R is good with

regular expressions

slide-16
SLIDE 16

UNLOCKING THE REGISTRY

RESEARCH

slide-17
SLIDE 17

0.0 0.2 0.4 0.6 0.8 1.0 1 2 3 4 5 6 7 8 9 10 Time from procedure (years) Survival probability

  • No. at risk

1415 991 779 559 398 276 180 114 64 23 6

All octogenarians having MV surgery

Evidence based medicine

Octogenarians having Mitral Valve Surgery ± CABG ± TV repair

  • ver 10-year window

survfit + Surv {survival} kmplot {by Tatsuki Koyama} Mean 4 patients per unit / year

slide-18
SLIDE 18

Contemporary statistical methodology for retrospective data

Unmatched Unmatched

3 2 1 1 2 0.0 0.2 0.3 0.5 0.6 0.8 0.9 Mechanical Biological Propensity score

Matched Matched

3 2 1 1 2 3 0.0 0.2 0.3 0.5 0.6 0.8 0.9 Mechanical Biological

matchit {MatchIt}

Probability of receiving a mechanical valve Mechanical valve Biological valve Mechanical valve Biological valve

slide-19
SLIDE 19

Risk prediction: status quo

2002 2004 2006 2008 2010 0.02 0.04 0.06 0.08 0.10 Time Observed Expected Actual Overall average Trend

Mortality proportion Ratio = 0.37 Ratio = 0.73 2% 4% 6% 8% 10% Mortality Date of surgery

slide-20
SLIDE 20

Risk prediction: with R

+

Intercept −6.00 −5.75 −5.50 −5.25 2002 2004 2006 2008 2010

Time Coefficient

Estimate 95% CI No update Rolling 24−month window (12−months) Rolling 24−month window (1−month) Piecewise recalibration (12−months) Piecewise recalibration (24−months) Dynamic logistic regression

logistic.dma {dma}

slide-21
SLIDE 21

CONCLUSIONS

slide-22
SLIDE 22

Conclusions

  • We need to unlock healthcare registries to:
  • Monitor quality & avoid a repeat of Bristol
  • Revalidation of professional credentials
  • Facilitate patient choice
  • Develop & validate evidence based medicine
  • Increase in demand
  • We can do it all in R!
slide-23
SLIDE 23

Comments & suggestions

  • Funded by Heart Research UK [Grant Number

RG2583]

  • Dr Norman Stein, North West e-Health

Acknowledgements

graeme.hickey@manchester.ac.uk