ISSN: 2161-069X

Journal of Gastrointestinal & Digestive System
Open Access

Our Group organises 3000+ Global Conferenceseries Events every year across USA, Europe & Asia with support from 1000 more scientific Societies and Publishes 700+ Open Access Journals which contains over 50000 eminent personalities, reputed scientists as editorial board members.

Open Access Journals gaining more Readers and Citations
700 Journals and 15,000,000 Readers Each Journal is getting 25,000+ Readers

This Readership is 10 times more when compared to other Subscription Journals (Source: Google Analytics)
  • Mini Review   
  • J Gastro intest DigSyst, Vol 12(3)
  • DOI: 10.4172/2161-069X.1000678

Exploring 30 day Mortality Variability in the Context of Radiological Gastrostomy: How Important Are Month to Month Differences?

Martin Hennessy*
Department of Interventional Radiology, Queen Elizabeth University Hospital, United Kingdom
*Corresponding Author: Martin Hennessy, Department of Interventional Radiology, Queen Elizabeth University Hospital, United Kingdom, Email: martin.hennessy@ggc.scot.nhs.uk

Received: 25-Feb-2022 / Manuscript No. JGDS-22-55577 / Editor assigned: 28-Feb-2022 / PreQC No. JGDS-22-55577(PQ) / Reviewed: 14-Mar-2022 / QC No. JGDS-22-55577 / Revised: 18-Mar-2022 / Manuscript No. JGDS-22- 55577(R) / Published Date: 25-Mar-2022 DOI: 10.4172/2161-069X.1000678

Abstract

Purpose: Radiological gastrostomy catheter insertion is a well-established procedure to provide enteral nutrition to patients unable to do so themselves. It carries risks and an associated 30 day mortality rate. After referring clinicians perceived increase in early mortality after gastrostomy insertion, we aimed both to determine whether this was a true difference or random variation and how best to communicate this.

Material and Methods: Data for 696 consecutive gastrostomy insertions in 661 patients performed between 2014 and 2020 were collected retrospectively. A literature search was performed for gastrostomy series with 30 day mortality data. Mortality variation was compared to random variation and visualised with a funnel plot. Mortality rate was compared to existing literature. Survival analyses were performed to compare survival among indications.

Results: We found 30 day mortality variability to be indistinguishable from random variation and visualised it to demonstrate no significant outlier and also showed that it compared favourably to published literature. Patients with motor neurone disease had a significantly worse survival than those with ear, nose and throat cancers at 30 days and one year (p<0.05).

Conclusion: Mortality after gastrostomy catheter insertion varies over time but statistical methods can be used to help assess whether the variability is random. A funnel plot is an ideal visualisation for such data and should not be limited to comparing institutions or operators. Some patient groups have significantly worse outcomes after gastrostomy than others.

Keywords: Gastrostomy; Mortality rate; Statistics; Radiological

Introduction

Radiologically inserted gastrostomy (RIG) is an interventional radiology (IR) procedure with a history four decades long [1]. Broadly speaking, there are two insertion mechanisms, one by which the gastrostomy catheter passes into the stomach through the skin (Percutaneous Radiological Gastrostomy-PRG), and the other by which the gastrostomy catheter passes out of the skin through the stomach (Per-Orum Inserted Gastrostomy- PIG); the techniques are well described elsewhere [2-4]. The procedure is widely accepted, with technical success in the literature between 93% and 100% and procedure related mortality between 0% and 3.9%, comparing reasonably with endoscopic and surgical insertion methods [5-8]. Guidelines from the Society for Interventional Radiology (SIR) and Cardiovascular and Interventional Radiology Society of Europe (CIRSE) suggest procedure related mortality should be 0% to 2% and 0.3%, respectively, but do not specifically define procedure related mortality [9,10].

Thirty day mortality after gastrostomy varies between 0% and 40% in the literature with SIR guidelines suggesting 6.7% to 26% and CIRSE guidelines commenting on the variability in the literature without specifying a recommended range [9-12].

With wide variability in the literature, it is unsurprising that RIG 30 day mortality also varies with time, from low and reassuring to higher and potentially worrying. It is important therefore to be able to confidently and correctly differentiate random variability in 30 day mortality from practices causing that variability. Visualisation of 30 day mortality variability has been key in assessing high profile situations such as paediatric cardiac surgery [13].

In December 2016 and January 2017, referring clinicians perceived an unacceptable rise in RIG 30 day mortality at our institution and after consideration, changes in process and practice were implemented in the department. At no point did we seek to determine if the mortality increase was real and the changes were justified.

Today, only one of the changes made is still in place and there have never been further concerns raised. With that in mind, the primary aim of this paper is to explore and compare statistical methods by which variability in mortality rates can be quickly assessed and visualised. The first method will be to perform a post-hoc sample size calculation to conceive a clinical trial comparing mortality rates between groups. The second method is to test whether RIG 30 day mortality has a Poisson distribution. A Poisson distribution expresses the statistical probability of an event (in this case RIG 30 day mortality) occurring in a fixed time interval based on a known mean event rate and assuming new events are independent from previous events [14]. Thirdly, we visualise our RIG 30 day mortality using a funnel plot. Secondary aims are to succinctly present our large volume gastrostomy data and to compare our RIG 30 day mortality to the published literature, again using a funnel plot.

Materials and Methods

Procedural data were collected from the Radiology Information System.

Patient data were collected from the electronic patient record. Mortality data were collected from a national patient database. We included procedures from 1st January 2014 to 30th June 2020 performed at three local hospitals. For mortality calculations, each patient was entered into the dataset once. Gastrostomy catheter insertion was performed on some patients more than one time. Re-insertion procedures were only considered as a data point for survival analysis if a new gastric puncture was required for re-insertion.

The UK National Research Ethics Service (NRES) guidelines define the methods we used as service evaluation and state that ethical approval is not required for service evaluation [15]. Data were analysed using the language and environment for statistical computing, R (R Foundation for Statistical Computing, Aut.) in the RStudio indegrated development environment using packages Tidyverse, survival, lubridate, bibtex, pander, ggpubr, pwr, plyr and survminer [16,17]. Shapiro-Wilk normality test was used to assess normality of distributions. Chi-squared test was used to compare the number of patients who died each month with a number predicted by a Poisson distribution. For abnormally distributed data, the non-parametric Kruskal-Wallis test was used to compare the age of patients in each diagnosis group and Wilcoxon multi-pairwise comparison was used to determine which groups differed. Kaplan-Meier method was used for all survival analyses, with Log-Rank test being used to compare survival between groups. Bonferroni correction of p-values was performed when multiple comparisons were made.

Results

Patients

Between January 1st 2014 and June 30th 2020, 696 consecutive gastrostomies were performed in 661 patients. Some patients who had gastrostomy in late 2019 and all patients who had gastrostomy in 2020 did not have full one year follow up and so one year mortality may increase from the values presented. 630 patients had one gastrostomy insertion, 27 patients had two gastrostomy insertions and 4 patients had three gastrostomy insertions.

The patients’ underlying condition was grouped into seven categories: ear, nose and throat cancers (ENT) and their management, motor neurone disease (MND), stroke (CVA), oesophageal disease (OES), other neurodegenerative diseases (NEU), traumatic brain and spine injuries (INJ) and the remaining miscellaneous or un-diagnosed conditions (UNK). Due to the low number of cases, OES, NEU, INJ and UNK groups were excluded from direct statistical comparisons between underlying diagnoses.

A summary of patient diagnoses, age, number and method of procedures, survival and mortality rates is provided in (Table 1). CVA patients were older than both ENT and MND patients (p<0.05). There was no significant difference between the ages of ENT and MND patients (p=1).

Table 1: Number of patients, their gender and age, 30 day and one year mortality, number of procedures, gastrostomy type and median survival broken down by diagnosis.

Diagnosis Patients Men Women Mean age (years) Median age (years) 30 day mortality 1 year mortality Procedures PRG PIG Median survival (days)
All 661 421 240 64 66 38 (6) 299 (45) 696 523 (75) 173 (25) 463
ENT 325 226 99 64 65 11 (3) 140 (43) 345 329 (95) 16 (5) 514
MND 107 63 44 64 65 12 (11) 63 (59) 110 64 (58) 46 (42) 299
CVA 82 42 40 74 77 5 (6) 37 (45) 83 29 (35) 54 (65) 562
INJ 37 29 8 57 54 3 (8) 14 (38) 41 25 (61) 16 (39) 612
NEU 40 27 13 57 60 0 (0) 12 (30) 43 26 (60) 17 (40) 941
UNK 45 23 22 56 62 5 (11) 18 (40) 46 25 (54) 21 (46) 762
OES 25 11 14 69 73 2 (8) 15 (60) 28 25 (89) 3 (11) 227
All=all patients, ENT=Ear, nose and throat cancers and their management, MND=motor neurone disease, CVA=stroke, OES=oesophageal disease, NEU=other neurodegenerative diseases, INJ=traumatic brain and spine injuries and UNK=miscellaneous or un-diagnosed conditions. Unspecified values are numbers. Values in parentheses are percentages. The location of age data in the table is emboldened to reflect the distribution of age in the diagnosis group, ie. groups with patients of normally distributed age have mean age emboldened and those abnormally distributed have median age emboldened. 1 year mortality values are a minimum, as not all patients had one year follow up at the time of data analysis.

Post-Hoc sample size calculation for a conceptual clinical trial

The observed 30 day mortality rate was 6% (661 patients, 38 deaths). Choosing a minimum clinically significant 30 day mortality increase as 10%, power of 0.8 and significance level of 0.05, two equal groups of 113 patients would be required for a comparison of 30 day mortality. Alternatively, using the 661 patients in these data as one experimental group, 62 patients would be required in a second group. To increasing the power to 0.95, 116 patients would be required in a second group. For reference, 21 patients had gastrostomy insertion in December 2016 and January 2017 (the two months which caused concern in our situation) combined.

Monthly variation in gastrostomy procedures and 30 day mortality

Between 1 and 18 patients had a gastrostomy insertion each month; these were abnormally distributed with a median of 8 and interquartile range (IQR) of 6-11. Between 0 and 3 patients died within 30 days of gastrostomy insertion each month; abnormally distributed with a median of 0 and IQR 0-1. RIG 30 day mortality each month ranged from 0 to 33% (median 0%, IQR 0%-9%).

The mean number of patients who died within 30 days each month was 0.49 (38 patients in 78 months). If RIG 30 day mortality is a Poisson random variable, the expected frequency that zero, one, two or three patients would die within 30 days each month can be calculated by Poisson probability. These are displayed, alongside the actual observed frequency, in (Table 2). Chi-squared test of these observed and expected numbers is not significant (p=1). In other words, the observed RIG 30 day mortality is statistically indistinct from predicted random variation. A Poisson probability distribution assumption predicts a probability that more than two patients die within 30 days of gastrostomy in any month is 1.3%.

Table 2: Observed and expected (based on assumed Poisson probability distribution) frequency of number of 30 day mortality patients each month.

Patients dead at 30 days Observed frequency Expected frequency
0 50 48
1 20 23
2 6 6
3 2 1

The RIG 30 day mortality for each month is shown as a funnel plot in (Figure 1). 39 published series with 30 day mortality data were found in the literature. Added to our data, they comprise 5711 patients with 7.9% 30 day mortality (454 deaths) and are shown in (Figure 2).

Journal-Gastrointestinal-Digestive-System-Funnel

Figure 1: Funnel plot of monthly 30 day mortality after radiologically inserted gastrostomy. The dotted line represents the benchmark/mean, the dark grey line represents two and the pale grey line three standard deviations from the benchmark/mean. The two months of concern are plotted as triangles, the remainder are an ‘x’. Random jitter has been applied along the x axis to reduce the overlap of individual points.

Journal-Gastrointestinal-Digestive-System-plot

Figure 2: Funnel plot of 30 day mortality after radiologically inserted gastrostomy from 39 published series and the current series. The dotted line represents the benchmark/mean, the dark grey line represents two and the pale grey line three standard deviations from the benchmark/mean. The current series is plotted as a triangle, the remainder are an ‘x’.

Survival analysis

30 day and one year Kaplan Meier survival curves for ENT, MND and CVA are shown in (Figure 3). At 30 days and one year, pairwise log-rank test shows the difference between ENT and MND is statistically significant (p=0.0023 and p=0.0082 respectively) while the differences between ENT and CVA and between MND and CVA are not statistically significant.

Journal-Gastrointestinal-Digestive-System-day

Figure 3: 30 day and one year survival after gastrostomy for Ear, Nose and Throat (ENT), Motor Neurone Disease (MND) and Stroke (CVA). Note the y-axes does not start at zero and differ between the two plots. Only the differences between ENT and MND are statistically significant.

Discussion

In this paper we have explored methods to objectively assess changes in a common and important outcome: 30 day mortality. We believe that funnel plots are a simple and, importantly, easily understood method for assessing, visualising and communicating these data. Their use is perhaps limited by a perception that their primary purpose is to compare institutional or even operator performance [18]. However, their methodology allows for their use in many other comparisons, in this case a change in outcome over a period of time.

To compare an outcome between groups, clinical trials are the gold standard in medical research. However, prospective analysis, blinding and randomisation would be impossible in the context of RIG 30 day mortality. Moreover, we calculated that a group of 116 patients would be needed to have a 95% chance of detecting a 10% rise in 30 day mortality compared to the control group of our current dataset of 661 patients. The maximum number of patients who had gastrostomy in any given month was 18; too small for a valid clinical trial.

Assuming Poisson distribution, we calculated the expected frequency of zero to three RIG 30 day mortality cases in a month. When compared to our observed monthly RIG 30 day mortality, the values were statistically indistinguishable. In other words, our 30 day mortality is indistinguishable from random distribution.

The simplicity of this calculation is its main benefit, but there are drawbacks to Poisson probability statistics. As discussed, it takes no variable into account other than the mean frequency of the outcome being assessed. In these data, our denominator (number of patients undergoing gastrostomy each month) was also highly variable, including two months in which fewer than three gastrostomies took place, invalidating any prediction of greater than two deaths occurring those months. For this reason, Poisson probability is perhaps better reserved for rare outcomes in large, stable populations (for example daily number of homicides in England and Wales) [14]. Additionally, while a Chi-squared table is familiar, Poisson probability may require explanation which is counter to our aim of quick and simple communication of information.

When each month’s number of gastrostomies and 30 day mortality rate are displayed on a funnel plot, the results are immediately visible. There is no significant outlier (above three standard deviations) in terms of high mortality. While both of the months which concerned our clinicians were on or above two standard deviations from the mean, there was a further five months when this was also true, and no concerns were ever raised about them. The fact that the months of concern were consecutive is a likely reason they caught the attention of the clinicians when the others did not. “We are far too willing to reject the belief that much of what we see in life is random [19].

For a wider perspective, we compared our data to 39 published data sets [7,11,12,20-55]. Ours is the second largest, and 30 day mortality compares favourably at around two standard deviations below the mean 30 day mortality of 7.9%. There were eight outliers above three standard deviations, half of which were small series below 50 patients, but the most striking outlier is the publication with the largest number of patients which reports well below three standard deviations of the mean 30 day mortality [50]. This seems to violate the Law of Large Numbers [14]. An explanation may be the fact that of all the publications, this is the only one in which its patients were voluntarily submitted to the researchers (the other publications largely being consecutive series) and so it was subject to selection bias.

A simple criticism would be that both funnel plots presented have made no attempt to correct for case mix. Our local survival data would suggest that if MND patients were over represented, 30 day mortality may appear higher. This was a deliberate decision. One of ours aims was simple data analysis and quick visualisation. Leaving the data ‘raw’ satisfies this aim. Moreover, in Figure 2, the case series with the fourth highest number of patients on the plot had a case mix with close to 90% neurological disease and yet their reported mortality remains close to the mean, perhaps showing that the effect of large numbers can balance a skewed case mix. There is an even simpler and more reason why we have not corrected our data before visualising it. Our funnel plots contain no judgement, blame or conclusions. They are not being used as tools in a meta-analysis or systematic review. They are smiply visualising data and allowing the observer to quickly assess if there is something worthy of investigation. Seeing a significant outlier would be the start of an investigation, not the end.

Another limitation is that we presented no root cause analysis into the cause of death of the patients in the months which raised concern with our clinicians. One of the responses to the concerns raised was to present all RIG 30 day mortality at the monthly departmental morbidity and mortality meeting for one year. In that year, no direct procedure related 30 day mortality occurred. While this does not mean it had not happened in the past, it is at least somewhat reassuring.

There may also be a perception that this exercise has little applicability outside interventional radiology or even outside the setting of gastrostomy practice. However, the methods presented can be applied to myriad outcomes rate of positive CTPA against source of referral, radiation dose during barium swallow by operator or monthly rate of pneumothorax after lung biopsy, for example. With these methods at your disposal, true, impartial feedback is available which is essential for meaningful self-reflection and institutional progress.

Conclusion

Apophenia is an all too human tendency to see patterns or correlations when there are none. When increased mortality is what you see, it is understandable that you want to act now for the good of your patients. It is therefore vital that we have methods to quickly and objectively analyse such observations and decide whether action is really required. Funnel plots are easy to produce and immediately understandable, with simple axes and readily explainable annotations (ie. the mean and curves). They also avoid the stigma of rankings or league tables. Their use should not be limited to institutional or operator comparisons, nor to gastrostomy, but offer a straightforward tool to visualise any outcome.

References

Citation: Hennessy M (2022) Exploring 30 day Mortality Variability in the Context of Radiological Gastrostomy: How Important Are Month to Month Differences? J Gastrointest Dig Syst.12:678. DOI: 10.4172/2161-069X.1000678

Copyright: © 2022 Hennessy M. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Top