Factors associated with treatment costs in patients with coronary artery disease in India: Comparison of linear regression, gamma regression and quantile regression methods
SabaAbidi1Email
ShridharDwivedi1Email
VinodSharma3Email
AnoopKumar1Email
SushamaTalegaonkar1✉Email
DennyJohn1Email
1
A
School of Allied Health Sciences and ManagementDelhi Pharmaceutical Sciences and Research University
2National Heart InstituteNew Delhi
3
A
Senior Consultant CardiologistNational Heart InstituteNew Delhi
4Department of Pharmacology, Delhi Pharmaceutical SciencesResearch University
5Department of Pharmaceutics, School of Pharmaceutical SciencesDelhi Pharmaceutical Sciences and Research University
6Public Health, Faculty of Life and Allied Health SciencesMS Ramaiah University of Applied SciencesBengaluru
Saba Abidi1#, Shridhar Dwivedi2, Vinod Sharma3, Anoop Kumar4, Sushama Talegaonkar5*, Denny John7*#
Affiliations:
1. PhD Scholar, School of Allied Health Sciences and Management, Delhi Pharmaceutical Sciences and Research University. E-mail: saba.abidi91@gmail.com, https://orcid.org/0000-0003-4381-4840
2. Senior Consultant Cardiologist, National Heart Institute, New Delhi. E-mail: shridhar.dwivedi@gmail.com
3. Senior Consultant Cardiologist, National Heart Institute, New Delhi. E-mail: drvs1994@rediffmail.com
4. Assistant Professor, Department of Pharmacology, Delhi Pharmaceutical Sciences and Research University. E-mail: abitmesra@gmail.com, https://orcid.org/0000-0002-7806-9986
5. Associate Professor, Department of Pharmaceutics, School of Pharmaceutical Sciences, Delhi Pharmaceutical Sciences and Research University. E-mail: stalegaonkar@dpsru.edu.in (Co-corresponding author), https://orcid.org/0000-0003-2211-5119
6. Professor, Public Health, Faculty of Life and Allied Health Sciences, MS Ramaiah University of Applied Sciences, Bengaluru. Email: djohn1976@gmail.com, https://orcid.org/0000-0002-4486-632X
*: Joint corresponding authors
Corresponding authors: Sushama Talegaonkar, E-mail: stalegaonkar@dpsru.edu.in, Denny John, Email: djohn1976@gmail.com
#- Contributed equally
Abstract
Introduction
: There is no uniformly agreed regression model for analysing cost data. The objective of the current study was to compare the performance of linear regression, gamma regression, and quantile regression and predict a better model using costs among patients with coronary artery disease (CAD).
Methods
A
A cross-sectional survey was conducted on CAD patients at a tertiary care hospital in New Delhi between May and October 2023. Descriptive statistics for direct and indirect costs were estimated, and their association with demographic and clinical variables was explored using linear, gamma and quantile regression along with prediction errors.
Results
A
560 CAD patients were interviewed (mean age 62 ± 10.50years). 182 patients were found to be on medical therapy only, and 378 patients underwent any procedure along with medical treatment. The highest and lowest costs were observed for patients who underwent coronary artery bypass graft (US$3323/per patient) and received only medical therapy (US$220/per patient). According to linear regression, gender, distance to the hospital and type of intervention significantly affected the expenditure. In gamma regression, only the type of intervention was statistically significant. In quantile regression, being male, living away from the hospital and having a high SES score positively affected the expenditure. Quantile regression was found to have fewer prediction errors.
Conclusion
Establishing an appropriate statistical model is fundamental for predicting the costs, which could be affected by several factors, and the final choice of the regression model should be made after careful assessment of predictive ability and tailored to specific data.
Keywords:
Cost analysis
coronary artery diseases
health expenditure
regression
A
A
A
Introduction
Cardiovascular diseases (CVDs) continue to be the prominent reason for premature mortality across the world, and the most prevalent CVD in India is coronary artery disease. [1, 2] Coronary artery disease (CAD) is a condition when the heart does not get sufficient blood and oxygen due to obstruction in the coronary arteries. [1] In 2022, globally, CAD affected 300 people, with a prevalence and mortality rate of 3610.2 and 108.8 per 1,00,000 population, respectively. [2] In 2016, CAD was the most prevalent type of cardiovascular disease, with a prevalence of 11% in India, contributing to a high economic burden. [3]
Recent evidence has suggested that CVDs are implicated in poverty due to cataclysmic health spending and mounting out-of-pocket expenditure (OOPE). (4–6) CVDs are responsible for the increased financial burden on the household budget and, ultimately, the national economy. Cost of Illness (COI) study provides evidence of the economic burden of disease on a country’s economy and offers insights to decision-makers to utilise the limited resources efficiently. COI is defined as the value of the resources that are expended or forgone due to a health problem, and includes health sector costs (direct costs), the value of decreased or lost productivity by the patient (indirect costs), and the cost of pain and suffering (intangible costs). [68]
In India, COI studies have been conducted for CVDs [9, 10], but not specifically for CAD. Previous studies have estimated the overall healthcare costs and OOPE for CVDs [11, 12]. However, the use of regression models has been limited. Propensity Score matching [13] and logistic regression [14, 15] methods have been widely used to estimate the effect of predictors on healthcare expenditures. Studies conducted in settings other than India have used different regression models to ascertain the relationship between expenditure on CVDs and covariates. Studies published from Finland, the United Kingdom and New Zealand used machine learning prediction models to conduct the regression analysis. [1618]. Lu et al (2023) used quantile regression to estimate the effect of independent variables on the expenditure of CVD for China. [19] Other generalised linear models were used in different countries, such as gamma regression in England and Japan [20, 21] and logistic regression in the USA [22]
In health economics, estimating the population mean costs is widely accepted as a statistic of interest to policymakers. [23] The non-negative nature of healthcare costs data most often exhibits substantial positive skewness, with heavy tails and is often multimodal. Estimating the mean cost and establishing a relationship between the costs and the predictor variables are the main challenges in developing regression models in healthcare. [24] As mentioned above, in healthcare systems, various statistical models are commonly used in predicting expenditure based on explanatory variables. Generalised Linear Models (GLMs) are regression models used to identify relationships between a dependent variable and predictor variables, including linear, logistic, Poisson, and exponential relationships. GLMs enable us to perform regression for non-normal distributions of the dependent variable. [25] The application of these models shows that they are robust to the placement of covariates and random effects. [26] Gamma regression is a type of GLM that is commonly used for analysing health expenditure for patients incurring costs greater than zero. Gamma regression models are flexible and do not require data transformation or removal of outliers to accommodate many outcome distribution shapes. [27, 28] Similar to gamma regression, quantile regression also works well in the presence of outliers and non-normal data. Quantile regression predicts the effect of a change in the defined quantile of the dependent variable with a change in the unit of the independent variable. [29] This approach has been found to be superior to linear regression and provides an inclusive presentation of factors that affect health expenditure. [29]
The current study aimed to apply more commonly used linear, gamma and quantile regression models in medical literature for analysing cost data in a cohort of patients receiving treatment for CAD to assess the consistency of findings regarding the significance of the clinical variables. It was hypothesised that the different models would result in different conclusions about the impact of demographic and clinical factors on the cost of treatment. The different models would have different abilities to correctly predict patient costs for CAD treatment in tertiary care healthcare facilities in India, and similar geographical settings.
Methods
This study was based on a cross-sectional survey conducted at a cardiac-specific tertiary care hospital in New Delhi from May-October 2023.
Sample Size Calculation
The sample size was calculated based on the estimated average costs, regardless of age and comorbidity. A previous study [10] shows that the standard deviation of average costs is approximately $ 2,400, and the average cost is $979. Expecting a precision of 20% on either side and estimating the average cost with a 95% confidence level, the sample size calculated was 555 subjects. Therefore, a total of 560 samples were taken for the study.
N=(Z1−α/2)2 * (SD)2
E2
N=(1.96)2* (2400)2
(200)2
553 ≅ 555
Z = Z score at 95% confidence interval, value = 1.96
SD = Standard deviation from Gupta et al. (2020)
E = Margin of error (calculated as E = mean x precision, E = 979*0.2 = 195.8 ≅ 200)
Eligibility criteria
Patients were directly recruited during their visits for regular check-ups in the hospital's cardiac OPD. Written informed consent was obtained prior to starting any interview with the patient.
A
The template of informed consent, as per guidelines by ICMR, has been included in the supplementary material (Supplementary 1). Patients above 18 years of age, both genders, visiting the hospital, and suffering from coronary artery diseases were included in the data collection. Patients having diseases other than coronary artery diseases like rheumatic heart disease, heart failure, congenital heart diseases, etc., patients not continuing the treatment at the hospital, and patients who were unwilling to participate in the study were excluded.
Data Collection
Two experts (ST & AK) designed the case record form (CRF) and two cardiologists (SD and VS) validated it (Supplementary 1). Firstly, the CRF was used to collect data from 20 patients in May 2023 and the collected data was checked for its adherence with the objectives. Changes suggested at this step were incorporated in the final CRF. The final CRF was used to collect information on socio-demographic characteristics, medical history, and treatment costs. Patients were selected using convenience sample and the information collected from May-October 2023.
Cost calculation
Participants were inquired if they received either medical therapy (MT) or any invasive procedure for CAD in the previous 12 months. The patients were divided into four groups, namely, only MT, MT + CAG (Coronary angiography), MT + PTCA (Percutaneous Transluminal Coronary Angioplasty) and MT + CABG (Coronary Artery Bypass Graft). Participants were asked if they had received either an outpatient (OP) or inpatient (IP) hospitalisation treatment (invasive procedure) for CAD in the previous 12 months. If affirmative for only MT, participants were asked to report the number of visits and medical expenditures for each category: medications, consultation fees, and laboratory or radiological tests. If the participant was hospitalised for any procedure, then the information about the procedure, length of hospital stay, and hospital costs was obtained from the hospital medical records. Data on direct non-medical expenditures, including expenses on travel to and from the clinic/hospital, whereas indirect costs included the time duration the patient spent at the hospital, and the number of days the patient was hospitalised. The cost of illness was calculated by considering both direct and indirect costs. Direct medical costs included the costs of medications, laboratory tests, consultations, procedures, and hospitalisation costs. Direct non-medical costs included travel costs, and indirect costs were productivity losses by the patient. The final cost data were converted into USD 2023 using the conversion rate of 1 US$ = 83.1164 INR [30].
The costs of medicines for CAD patients were identified from the CIMS (Current Index of Medical Specialities) website for branded drugs and the Jan Aushadhi website for generic drugs. For the patients who underwent any invasive intervention at the hospital, the total costs for their treatment, length of stay, laboratory costs, and consultation costs were obtained from their medical records and corroborated with payment receipts. The distance between the patient's point of origin and the hospital was calculated using the address present in the medical records. The average travel cost was used to calculate INR 30 (US$ 0.4) for 1.5 km and INR 11 (US$ 0.1) per kilometer. The cost was calculated for the patient's arrival and departure from the hospital. The number of visits done in one year multiplied by the travel cost per visit. Regarding the CAD patients on medical therapy, those who need to visit the OPD for regular check-ups were asked how many hours they spend at the hospital during each visit. If the number of hours was < 4, it was considered a half-day loss of productivity; if the patients reported spending > 4 hours on every visit, it was considered a full-day loss of productivity. The number of days lost due to hospital visits or hospital stays was multiplied by INR 176 (minimum wage per day) in India (US$ 2). The minimum wage was 176 Indian rupees, as reported by the Ministry of Labour in the wage floor index. [31]
Independent variables
Socio-economic status was calculated using the Kuppuswamy scale [33], presented in the Supplementary material (Supplementary 3). This scale is based on a cumulative score-based on education, occupation, and income variables. Based on this scale, patients were classified into five socio-economic status categories: Upper (I), Upper Middle (II), Lower Middle (III), Lower (IV), and Very Lower (V). However, socioeconomic status (SES) was taken as a continuous variable for the analysis, using the Kuppuswamy score as the SES score. Other variables included age, gender, distance to hospital, and type of intervention undergone by the CAD patients
Statistical Analysis
The descriptive statistics were used to calculate the measure of central tendency and measures of dispersion (Mean, median, Standard deviation and interquartile range) using MS Excel. Appropriate statistical tests were used to measure the significance level between the mean values. The costs were presented as mean, standard deviation, median and interquartile range (IQR) values. The socioeconomic class was calculated based on the Kuppuswamy scale [32].
First, simple linear regression was used to identify the factors associated with annual cost. The dependent variable was the total expenditure. The explanatory variables, which could explain the dependent variable, were identified as age, gender, distance to the hospital, socioeconomic status score, and type of intervention the CAD patients underwent. Then, a multiple regression analysis was performed to determine the factors affecting the total expenditure, and adjusted coefficients with a 95% confidence interval (CI) were calculated. The best-fit model was identified using multiple regression.
Next, gamma regression models were conducted to estimate the healthcare expenditure associated with explanatory variables and the model with the lowest AIC (Akaike information criterion) score was considered. In most conditions, the gamma regression model effectively estimates population means of healthcare costs. [34] The generalised linear model with log link and gamma distribution was found be appropriate, and age, gender, distance to hospital, SES score and type of intervention were the independent variables. Age, distance to hospital and SES score were taken as continuous variables and gender and type of intervention were taken as categorical variable.
Quantile regression for expenditure was performed at intervals of 50th, 75th, 90th and 95th percentile, and the coefficients (95% CI) were checked for positive or negative impact of expenditure [30].
The ability to predict costs was assessed using root mean squared (RMSE) and mean absolute errors (MAE) were calculated for all the regression models used to identify a better model. The errors for quantile regression were calculated for 50th percentile (by default quantile regression is a median regression) [34].
R software v4.4.2 (R Foundation for Statistical Computing, Vienna, Austria) was used to analyse the data, and a p-value of < 0.05 was considered statistically significant. All costs were converted into US$ per 2023 values (1 INR = 83.1164 US$) based on December 29, 2023).
Table 1
Socio-demographic profile of the included CAD patients Abbreviations: CAD: Coronary artery disease, SD: Standard deviation, MT: Medical therapy, CAG: Coronary angiography, PTCA: Percutaneous transluminal coronary angioplasty, CABG: Coronary artery bypass graft.
Characteristics
n(%) N = 560
Mean age (SD) years
62 ± 10.50
Gender
 
Male
414 (73.9%)
Female
146 (26.1%)
Marital Status
 
Married
476 (85%)
Widower
79 (14.1%)
Unmarried
5 (0.9%)
Socioeconomic Status
 
Lower
3 (0.5%)
Upper Lower
6 (1.1%)
Lower Middle
97(17.3%)
Upper Middle
375 (67%)
Upper
79 (14.1%)
Type of intervention
 
Only medical therapy (MT)
182 (32.5%)
MT + CAG
134 (23.9%)
MT + PTCA
212(37.9%)
MT + CABG
32(5.7%)
Table 2
Break up of the direct and indirect costs for managing CAD (in US$ 2023)
Type of intervention
Direct medical costs (US$)
Total direct costs
(US$)
Total indirect costs
(US$)
Total costs of illness
(US$)
Medical
 
Non-medical
 
Productivity losses
 
Consultation
Laboratory
Medication
Cost of procedure
Transportation
Only Medical therapy
       
Mean (SD)
33(10)
66(20)
119(122)
-
19(10)
237(124)
8(4)
246(124)
Median (IQR)
36(24–42)
72(48–84)
89(42–157)
-
17(11–26)
214(156–279)
7(5–11)
220(166–290)
% of COI
13.3
26.9
48.5
 
7.8
 
3.3
100%
MT + CAG
        
Mean (SD)
34(10)
68(21)
110(100)
213(19)
19(10)
444(103)
10(4)
455(104)
Median (IQR)
36(24–42)
66(48–84)
90(33–156)
205(0)
17(10–26)
430(370–487)
10(7–13)
445(380–500)
% of COI
7.5
14.9
24.3
47
4.1
 
2.3
100%
MT + PTCA
        
Mean (SD)
33(10)
69(20)
135(126)
2275(258)
21(14)
2531(291)
13(4)
2545(291)
Median (IQR)
36(24–42)
72(48–84)
126(44–174)
2108(2108–2589)
19(10–29)
2409(2323–2729)
13(11–15)
2420(2334–2741)
% of COI
1.3
2.6
5.3
89.4
0.8
 
0.5
100%
MT + CABG
        
Mean (SD)
33(9)
62(20)
113(115)
3008(721)
19(9)
3648(721)
25(4)
3674(720)
Median (IQR)
30(24–40)
60(36–84)
115(22–145)
3008 (3008–3609)
17(13–24)
3297(3219–3756)
25(22–29)
3323(3246–3782)
% of COI
0.9
1.7
3.1
93.1
0.5
 
0.7
100%
Abbreviations: CAD: Coronary artery disease, SD: Standard deviation, MT: Medical therapy, CAG: Coronary angiography, PTCA: Percutaneous transluminal coronary angioplasty, CABG: Coronary artery bypass graft, IQR: Interquartile range, COI: Cost of Illness
Table 3
Socio-demographic correlates of the expenditure for managing CAG (in INR)
Variables
Number
Mean cost
SD
p value
No.
Mean cost
SD
p value
No.
Mean cost
SD
p value
No.
Mean cost
SD
p value
Gender
Males
138
19,773
10,472
0.4
94
36,872
9147
0.4
160
2,11,210
24,536
0.19
22
3,19,219
65,012
0.01*
Females
44
19,594
9,908
 
40
37,032
6790
 
52
2,07,881
22,534
 
10
2,68,115
5,786
 
Total
182
   
134
   
212
   
32
   
Age group (in years)
> 30
0
       
1
1,97,064
  
0
   
31–40
0
   
3
38,072
3,125
 
3
2,06,678
9,713
 
1
2,73,369
  
41–50
22
22,045
14,250
 
18
35,422
5,771
0.23
32
2,09,582
23,626
0.42
2
2,68,815
8,047
 
51–60
47
19,236
9,131
0.17
37
36,780
7,585
0.26
63
2,12,095
22,670
0.31
10
3,18,153
63,061
0.16
61–70
76
19,209
9,917
0.49
41
38,713
11,337
0.19
70
2,11,620
27,659
0.46
13
3,08,732
73,115
0.37
> 71
37
20,051
9,643
0.34
35
35,640
7,021
0.08
43
2,07,077
21,832
0.18
6
2,82,987
24,208
0.21
 
182
   
134
   
212
   
32
   
Socio-economic status
Lower (< 5)
1
13,840
  
1
38,008
  
1
2,14,170
  
0
   
Upper lower (5–10)
3
29,096
25,474
 
2
32,762
1,343
 
1
1,91,802
  
0
   
Lower middle (11–15)
28
23,563
14,184
0.28
29
39,945
11,161
0.19
35
2,09,243
23,455
 
5
3,23,512
60,375
 
Upper middle (16–25)
121
18,929
9,146
0.02*
85
36,576
7,984
0.04*
143
2,09,516
24,095
0.48
26
3,00,549
61,150
0.22
Upper (26–29)
29
18,604
8,151
0.43
17
33,906
5,586
0.1
32
2,16,038
25,703
0.09
1
2,72,151
  
 
182
   
134
   
212
   
32
   
Abbreviations: CAD: Coronary artery disease, MT: Medical therapy, CAG: Coronary angiography, PTCA: Percutaneous transluminal coronary angioplasty, CABG: Coronary artery bypass graft
Table 4
Multiple linear regression related to the cost of managing CAD versus explanatory variables
Explanatory variables
Estimate
Std. Error
t-value
P value
Age
-58.41
87.45
-0.668
0.5044
Gender
4359.18
2105.45
2.070
0.0389*
Distance to hospital
136.48
56.98
2.395
0.0169*
SES (Socio-economic Status) Score
-23.85
187.11
-0.127
0.8986
Type of intervention (CAG)
-266088.12
4262.34
-62.428
< 2e-16*
Type of Intervention (MT)
-283775.99
4151.92
-62.428
< 2e-16*
Type of intervention (PTCA)
-93357.38
4111.90
-22.704
< 2e-16*
Constant
300776.13
7898.45
38.080
< 2e-16*
Multiple R-squared error: 0.9553
Adjusted R-squared: 0.9548
F-statistic: 1687, p = < 2.2e-16*
* statistically significant
Table 5
Gamma regression fitting between costs of managing CAD and explanatory variables
Variables
Coefficient
Std error
T value
p > t
Min
Max
Constant
12.7833910
0.1196379
106.851
< 2e-16 ***
12.549059131
13.0190129610
Age
-0.0014330
0.0013245
-1.082
0.2798
-0.004048067
0.0011831384
Gender
0.0248592
0.0318912
0.779
0.4360
-0.037912607
0.0870345719
Distance to hospital
0.0005994
0.0008630
0.695
0.4876
-0.001071271
0.0023383127
SES score
-0.0054081
0.0028341
-1.908
0.0569
-0.010959666
0.0001302076
Intervention_CAG
-2.1064305
0.0645617
-32.627
< 2e-16 ***
-2.234674162
-1.9814599473
Intervention_MT
-2.7330792
0.0628891
-43.459
< 2e-16 ***
-2.858111706
-2.6115956983
Intervention_PTCA
-0.3644606
0.0622829
-5.852
8.35e-09 ***
-0.488373150
-0.2441954623
Abbreviations: CAD: Coronary artery disease, MT: Medical therapy, CAG: Coronary angiography, PTCA: Percutaneous transluminal coronary angioplasty, CABG: Coronary artery bypass graft
Table 6
Quantile regression related to the cost of managing CAD versus explanatory variables
Explanatory variables
50th percentile
75th percentile
90th percentle
95th percentile
 
Coefficient
Confidence interval (CI 95%)
Coefficient
Confidence interval (CI 95%)
Coefficient
Confidence interval (CI 95%)
Coefficient
Confidence interval (CI 95%)
Constant
270401.68425
265768.82017
278039.83174
312606.15721
297624.14853
330645.38246
3.985188e + 05
3.729535e + 05
4.833000e + 05
4.634128e + 05
3.646881e + 05
5.865319e + 17
Age
-7.76587
-102.56037
30.50782
-27.20200
-166.35390
106.13765
-4.044573e + 01
-2.777377e + 02
2.480342e + 02
5.669970e + 01
-6.068753e + 02
5.353836e + 02
Gender_ female
ref
           
Gender_Male
656.28976
-690.88277
2983.85368
653.12905
-1176.19476
3549.60095
2.192931e + 03
-2.561066e + 03
4.277820e + 03
3.232639e + 03
-7.069361e + 03
1.489640e + 04
Distance to hospital
126.76145
46.66696
197.21410
47.89031
-69.72284
213.66360
2.016017e + 02
3.182000e-02
2.459558e + 02
1.129105e + 02
9.663726e + 01
6.506381e + 02
SES score
6.36178
-161.65795
105.92380
-3.30639
-359.84445
191.68708
-3.501202e + 02
-7.939376e + 02
5.976711e + 01
-3.032675e + 02
-1.304123e + 03
5.749988e + 02
Intervention_CABG
ref
           
Intervention_CAG
-237587.14152
-271129.44875
-234448.66329
-271161.14839
-347446.70934
-235178.51516
-3.482743e + 05
-4.194137e + 05
-2.622842e + 05
-4.159872e + 05
-1.797693e + 308
-3.375655e + 05
Intervention_MT
-256300.94957
-292585.00536
-253436.72912
-289546.48062
-404123.40426
-252569.93579
-3.654485e + 05
-4.371809e + 05
-3.471466e + 05
-4.298887e + 05
-1.797693e + 308
-3.500863e + 05
Intervention_PTCA
-73488.03759
-185378.90307
-69869.62553
-86553.58780
-160436.30701
-49165.63535
-1.528508e + 05
-1.465053e + 17
-1.340770e + 05
-2.057781e + 05
-1.797693e + 308
-4.289018e + 04
Abbreviations: CAD: Coronary artery disease, MT: Medical therapy, CAG: Coronary angiography, PTCA: Percutaneous transluminal coronary angioplasty, CABG: Coronary artery bypass graft
Table 7
Comparison of regression models and their prediction errors
Explanatory variables
Multiple regression
Quantile
Regression (50th percentile)
Gamma regression
Coefficients
Age
-58.41
-7.76587
-0.0014330
Gender
4359.18
656.28976
0.0248592
Distance to hospital
136.48
126.76145
0.0005994
SES score
-23.85
6.36178
-0.0054081
Intervention_CAG
-266088.12
-237587.14152
-2.1064305
Intervention_MT
-283775.99
-256300.94957
-2.7330792
Intervention_CABG
-93357.38
-73488.03759
-0.3644606
Prediction errors
Root mean squared error (RMSE)
21489.32
23510.63
151437.7
Mean absolute error
13816.55
12469.61
112213.1
Abbreviations: CAD: Coronary artery disease, MT: Medical therapy, CAG: Coronary angiography, PTCA: Percutaneous transluminal coronary angioplasty, CABG: Coronary artery bypass graft
Ethical Approval
A
A
The study protocol has been approved by the Institutional Ethics Committee of Delhi Pharmaceutical Sciences and Research University (DPSRU-BREC/2022/A/041) and the National Heart Institute (3/9/002/EC/2023). Patients were administered with informed consent form and consent was obtained prior to data collection.
Results
A
The mean age (SD) of the 555 respondents was 62 (± 10.50) years, with two-thirds of the respondents being males (Table 1). About 85% of the participants were married and 61% were retired. More than half (67%) of the participants belonged to upper middle class, followed by lower middle (17.3%) and upper (14.1%) classes. Of the participants, 32.5% underwent only medical therapy, and the remaining 67.5% either PCI or CABG in addition to MT in the last year. (Table 1) The distribution of cost data was positively skewed, with a small minority of patients having very high costs (Fig. 1).
The median (IQR) annual illness cost for patients who only took medical therapy was [US$ 220(US$166-US$290)] (Table 2). For patients who underwent coronary angiography and received medical therapy, the median (IQR) cost of illness was estimated to be US$ 445 (US$380-US$500) per year. For patients who underwent percutaneous intervention or CABG in conjunction with medical therapy in the previous year, the median cost of illness was calculated to be US$ 2,420 (US$ 2,334-US$ 2,741) and US$ 3,323 (US$ 3,246-US$ 3,782), respectively. For patients on MT, almost half (48.5%) of the cost of illness was attributed to medications. In the case of invasive interventions, the cost of interventions dominated the cost of illness. The median (IQR) annual direct costs for only medical therapy were US$ 214(US$156-US$279). For patients on medical therapy and an invasive intervention, the median direct costs were US$ 430(US$370-US$487) for CAG, US$ 2409(US$2323-US$2729) for PTCA and US$ 3297(US$3219-US$3756) for CABG. The highest indirect costs (US$ 25(US$22-US$29)] were observed for CAD patients undergoing CABG, and the lowest for only MT [US$ 7(US$5-US$11)]. (Table 2) Most of the costs were statistically insignificant (p > 0.05). The mean cost of treating CAD without procedures and with CAG in lower middle socio-economic status was statistically significant compared to the upper middle group with p values of 0.02 and 0.04, respectively. Similarly, the mean cost of CAG was reported to be statistically significant when compared between males and females (p = 0.01). (Table 3)
The R2 value for the linear regression was 95.53% indicating the variation in the outcome variable expenditure explained by the predictors. The adjusted R2 is almost equal to the multiple R-square, thus highlighting that the model has good cross-validity. The effect of the type of intervention was found to be statistically significant. The coefficient for age was − 58.41, gender 4359.18, distance 136.48, and SES score − 23.85, with the intercept at 300776.13. Gender and distance to the hospital had a statistically significant impact on the expenditure for managing CAD, with p values of 0.0389 and 0.0169, respectively. (Table 4)
Gamma regression with the logarithmic function was identified as the appropriate model because it had the lowest AIC. Gamma regression found that only the type of intervention significantly affected the expenditure for managing CAD. CABG intervention was taken as a baseline, and the β coefficients (p-value) for CAG, MT and PTCA were found to be -2.1064305(< 0.01), -2.7330792 (< 0.01) and − 0.3644606 (< 0.01). The patient's age (β = -0.0014330) and gender (β = 0.0248592) had negative and positive effects, respectively, but were not statistically significant. The constants obtained in the model were associated with a significant level of significance. (Table 5)
We performed quantile regression to estimate the effect size of explanatory variables on different percentiles of expenditure, and the results show that as the distribution quantile of the dependent variable (cost) increased, the beta coefficient also surged from 27,041 to 4,63,000. The magnitude of the estimated coefficient was due to the skewness of the dependent variable. (Table 6). In all percentiles (50%, 75%, 90% and 95%) of the cost distribution, the male patients positively affected the expenditure. Age showed a negative association with expenditure in all quantiles of data distribution. Results of the estimation of coefficients showed that the distance to the hospital had a positive effect on expenditure in all quantiles except on the highest (95th quantile). SES score varied expenditure across different quantiles (positive on 50th quantile and negative on 75th, 90th, 95th quantile). When patients undergoing CABG was taken as baseline, all the interventions had a negative effect on the expenditure for managing CAD across all the quantiles.
A
A
A comparison of the multiple linear regression, gamma regression and quantile and regression was conducted. Multiple regression model was found have the lowest RMSE (21489.32) and MAE (13816.55) as compared to other two models. However, when comparing quantile regression and gamma regression, quantile regression was found to have lesser RMSE (151437.7) and MAE (112213.1) than gamma regression. (Table 7). For the models that predicted median cost, a median regression line was superimposed on the plot [36]. These plots are depicted in Figs. 2 & 3. The models that predicted mean costs tended to fit the data well. Linear regression and gamma regression model predicted median costs well.
Discussion
This study estimated the direct and indirect costs of managing CAD in an Indian tertiary care center and determine the relationship between these costs and independent variables using multiple linear regression, gamma regression, and quantile regression methods and compared the results of these models.
This study found that a significant part (50%) of the costs incurred by the patients for managing CADs through medical therapy pertained to the costs of medications which is similar to another study, which concluded that the cost of drugs accounts for the principal proportion (39%) of economic burden on patients [36]. Karan et al (2010) in a discussion paper published by the World Bank state that the expenses per OPD visit to a private hospital for any heart disease were INR 485 (US$ 6) [37]. The results from the study by Chauhan et al (2012) conducted in North India, estimated the costs incurred by patients who got treated in outpatient department sessions as INR 48578 (US$ 584) for two years, which is comparable to our study where annual cost was estimated to be US$ 246 per patient [36]. Huffman et al (2011) calculated the mean out-of-pocket expenditure for heart diseases for over 15 months as Int$2,917 (US$ 35) in India [38].
Gheorghe et al (2018) conducted a systematic review of the economic burden of CVD and HTN in low- and middle-income countries.[39] This study concluded that for CHD and stroke cost estimates were generally higher, with several estimates over $5000 per episode, which is nearly half of the estimate for CAD patients who were hospitalised and underwent PTCA in our study (US$ 2545). The cost estimates for ACS have been reported in Iran, which is a lower-middle-income country like India. In Iran, Sheikhgholami et al. (2021) calculated the economic costs associated with ACS. [40] They estimated the costs for medical therapy, PCI and CABG as USD1906 [US$(2023) 2115], US$4710 [US$(2023) 5225] and US$6545 [USD(2023) 7261), as compared to our study, we also found that the expenditure was lowest for medical therapy and highest for CABG. However, the cost for CABG was fairly high in our study.
A review by Gregori et al. (2011) found that no specific model can address all the problems of the analysis of healthcare expenditure and concluded that the decisive model is identified based on the type and design of the study [41]. However, many studies have used different regression models to arrive at the most appropriate model. [4243] The present study performed multiple linear regression analysis to identify the best model that can explain all the data, and the model that best fits the data was identified. The most suitable model was employed to investigate the relationship between factors associated with costs and expenditures. Regression, which performs well even in the presence of outliers, enables us to observe the relationship between the expenditure for managing CAD and the independent variables. The results from quantile regression were found to be more informative than linear and gamma regression, even in the presence of outliers. This was proved from the results of the effects of explanatory variables on different quantiles of cost data distribution and also from the fact that the RMSE and MAE were lesser for quantile regression than gamma regression. AIC criteria was used to identify the best model which ensures the goodness of fit of the regression models.
The results of the quantile regression reveal that distance to the hospital and socioeconomic status have a positive effect on healthcare expenditure, which is understandable because the distance to the hospital tends to increase expenditure, as more resources are required to cover greater distances. Additionally, patients from higher socioeconomic backgrounds tend to spend more on healthcare. SES score had positive effect on the expenditure. Types of intervention and age have negative effect on the expenditure in quantile regression. Age has found to be negatively affecting the expenditure, as the age increases the expenditure decreases. This could be due to the fact that nowadays, people in younger age group have started having CAD and prefer to undergo invasive intervention like PTCA to have better clinical outcome. [44]
Karan et al (2014) conducted propensity score matching to estimate the effects of co-variates on CVD expenditure and concluded that OOPE on outpatient visits, transportation and drugs were significantly higher in CVD households than controls. [13] Distance to the hospital was found to be predictor of healthcare expenditure in our study also and drugs contributed the major portion of healthcare expenditure in CAD patients receiving only medical therapy. Yadav et al (2021) studied the relationship between demographic and clinical characteristics of patients with non-communicable diseases and the catastrophic expenditure using multivariable logistic regression analysis. They found that the households seeking care in private hospitals had higher percentage CHE due to hospitalisation than public hospitals. CHE also increased with longer duration of stay. [14] Patel et al (2020) used random effects logistic model to estimate the association of explanatory variables on CVD expenditure in India. They reported that urban areas and affluent individuals were significantly associated with higher expenditure. [15] Patients with high socio-economic status (SES) score were found to have higher expenditure on healthcare.
A study by Walker et al (2016), which examined healthcare utilisation and costs of patients with CAD using gamma regression, observed that being male and suffering from co-morbidities positively affect the CAD expenditure in the UK. [20] In Japan, Mukurami et al (2013) performed gamma regression and revealed that the annual medical expenditure was positively associated with CVD risk factors irrespective of a age and gender. [21] This differs from our study as we have not evaluated the effect of risk factors on the healthcare budget. The logistic (binomial and multinomial) regression by Nkemdirin et al (2023) conducted on USA cost data of CAD patients reported that demographics and clinical characteristics (co-morbidities, number of times of hospitalisation and length of stay) were significant predictors of healthcare utilisation. [22] As in our study, demographic characteristics such as socioeconomic status (SES) score and distance to the hospital positively affected healthcare expenditure. Quantile regression was performed by Lu et al. (2023) to identify key determinants of healthcare costs in patients with CVD in China. They found that the patients with high healthcare costs were male and older. [19] We also found that being male positively affects the healthcare expenditure and, conversely, age was found to have negative effects on the CAD healthcare expenditure.
We compared the predictive abilities of these models using the RMSE and MAE and found that quantile regression has a lesser RMSE and MAE when compared to gamma regression. So, quantile regression was a better model than gamma regression in our study. Similarly, Mohammadpour et al (2020) found that quantile regression was better for gastric cancer. [45] Austin et al (2003) compared different regression models for analysing CABG costs and concluded that the median regression model (of which quantile regression is a type) predicted the costs well. [46] In addition to the mentioned studies, gamma regression and quantile regression have been performed on healthcare expenditures for diseases other than CVDs, such as cancer [47], arthritis [48], multimorbidity [49], and surgical site infections [50].
To our knowledge, this is the first study of its kind to estimate the total cost of treatment for CAD and analyse the relationship between independent variables and healthcare expenditure for CAD in India using regression models. The limitations of this study include the cost data on which the analysis is based, which is limited to only one private hospital. Cost data from multiple private and government hospitals across the country could provide more generalizable results for a large country such as India. The operational, administrative, and human resource costs could not be calculated due to the hospital's unavailability of data. Additionally, the prevalence method was used to collect the cost details, which could only provide us with the annual costs. As total costs of managing CAD also include the subsequent costs for adherence to medicines and laboratory tests for follow-up years, this study was conducted only to estimate the expenditure for managing CAD to help the health policy planners or decision-makers take better decisions for health policy and resource allocation.
Conclusions
The findings of this study indicate that a cost analysis for CAD could be instrumental in planning and distributing healthcare resources in a resource-constrained country like India. The direct costs contributed significantly to the total costs as compared to the indirect costs. Among direct costs, intervention costs dominated other costs in patients who underwent invasive intervention. For patients who received only medical therapy, the highest costs were associated with the cost of medications. Statistically analysing the disease cost can be a potential economic asset for decision-makers to evaluate the economic burden of CAD in India.
Declarations
Clinical trial registration
Not applicable
A
Funding:
No funding was sought for this research.
A
A
Author Contribution
SA and ST conceptualised the topic. SD, VS and SA collected the data. DJ and SA did the data analysis. SA developed the first draft with support from DJ. All authors reviewed and edited the draft. All authors agreed before the submission of the final manuscript.
Conflicts of interest:
The authors declare no conflict of interest.
A
Data Availability
Dataset is available at doi: 10.6084/m9.figshare.28173890
Ethical Approval:
The study protocol has been approved by the Institutional Ethics Committee of Delhi Pharmaceutical Sciences and Research University (DPSRU-BREC/2022/A/041) and the National Heart Institute (3/9/002/EC/2023). Patients were given an informed consent form, and consent was obtained before data collection.
Consent to participate:
A
Written informed consent was obtained from all participants before data collection (Supplementary File 1)
Consent to publish:
Not applicable
A
Acknowledgement
The authors thank Dr Vivek Verma, Department of Statistics, Assam University, Silchar, Assam-788011, India, for supporting the data analysis.
Electronic Supplementary Material
Below is the link to the electronic supplementary material
References
1.
Mensah G, Fuster V, Murray CJL, et al. Global Burden of Cardiovascular Diseases and Risks, 1990–2022. J Am Coll Cardiol. 2023;82(25):2350–473.
2.
Kumar AS, Sinha N. Cardiovascular disease in India: A 360 degree overview. Med J Armed Forces India. 2020;76(1):1–3.
3.
Jo C. Cost-of-illness studies: concepts, scopes, and methods. Clin Mol Hepatol. 2014;20(4):327–37. https//doi/10.3350/cmh.2014.20.4.327.
4.
Allarakha S, Yadav J, Yadav AK. Financial Burden and financing strategies for treating the cardiovascular diseases in India. Social Sci Humanit Open. 2022;6(1):100275. https://doi.org/10.1016/j.ssaho.2022.100275.
A
5.
Kumar A, Siddharth V, Singh S, I, et al. Cost analysis of treating cardiovascular diseases in a super-specialty hospital. PLoS ONE. 2022;17(1):e0262190.
6.
Ankur K, Jose AP, Prabhakaran P, et al. The burgeoning cardiovascular disease epidemic in Indians – perspectives on contextual factors and potential solutions. Lancet Reg Health Southeast Asia. 2023;12:100156. https://doi.org/10.1016/j.lansea.2023.100156.
7.
Byford S, Torgerson DJ, Raftery J. Economic note: cost of illness studies. BMJ (Clinical research ed.).2000;320(7245):1335. https://doi.org/10.1136/bmj.320.7245.1335
8.
Joel E, Segel BA, RTI-UNC Center of Excellence in Health Promotion Economics. Cost-of-Illness Studies—A Primer, 2006 (Available from https://www.rti.org/sites/default/files/resources/COI_Primer.pdf). Accessed on 02 January 2025.
9.
Kumar A, Siddharth V, Singh S, I, et al. Cost analysis of treating cardiovascular diseases in a super-specialty hospital. PLoS ONE. 2022;17(1):e0262190.
10.
Gupta P, Singh K, Shivashankar R, et al. Healthcare utilisation and expenditure patterns for cardio-metabolic diseases in South Asian cities: the CARRS Study. BMJ Open. 2020;10:e036317. https://doi.org/10.1136/bmjopen-2019-036317.
11.
Kumar L, Anupam P, Gupta SK. Assessment of Economic Burden and Quality of Life in Stable Coronary Artery Disease Patients. Indian Journal of Medical Specialities 10(1):p 26–29, Jan–Mar. 2019, https://doi.org/10.4103/INJMS.INJMS_1_18
12.
Menon GR, Yadav J, John D. Burden of non-communicable diseases and its associated economic costs in India. Social Sci Humanit Open. 2022;5(1):100256.
13.
Karan A, Engelgau M, Mahal A. The household-level economic burden of heart disease in India. Trop Med Int Health. 2014;19(5):581–91. https://doi.org/10.1111/tmi.12281.
14.
Yadav J, Allarakha S, Menon GR, et al. Socioeconomic Impact of Hospitalization Expenditure for Treatment of Noncommunicable Diseases in India: A. Value Health Reg Issues. 2021;24:199–213. https://doi.org/10.1016/j.vhri.2020.12.010. Repeated Cross-Sectional Analysis of National Sample Survey Data, 2004 to 2018.
15.
Patel S, Ram F, Patel SK, et al. Cardiovascular diseases and health care expenditure (HCE) of inpatient and outpatient: A study from India Human Development Survey. Clin Epidemiol Glob Health. 2020;8(3):671–7. https://doi.org/10.1016/j.cegh.2019.12.024.
16.
Hautala AJ, Shavazipour B, Afsar B, et al. Machine learning models in predicting health care costs in patients with a recent acute coronary syndrome: A prospective pilot study. Cardiovasc Digit health J. 2023;4(4):s137–142. https://doi.org/10.1016/j.cvdhj.2023.05.001.
17.
Zhou J, Wu R, Williams C, et al. Prediction Models for Individual-Level Healthcare Costs Associated with Cardiovascular Events in the UK. PharmacoEconomics. 2023;41(5):547–59. https://doi.org/10.1007/s40273-022-01219-6.
18.
Nghiem N, Atkinson J, Nguyen BP et al. Predicting high health-cost users among people with cardiovascular disease using machine learning and nationwide linked social administrative datasets. Health Econ Rev.2023;13(9) https://doi.org/10.1186/s13561-023-00422-1
19.
Lu M, Gao H, Shi C, et al. Health care costs of cardiovascular disease in China: a machine learning-based cross-sectional study. Front Public Health. 2023;11:1301276. https://doi.org/10.3389/fpubh.2023.1301276.
20.
Walker S, Asaria M, Manca A, et al. Long-term healthcare use and costs in patients with stable coronary artery disease: a population-based cohort using linked health records (CALIBER). Eur Heart J - Qual Care Clin Outcomes. 2016;2(2):125–40. https://doi.org/10.1093/ehjqcco/qcw003.
21.
Murakami Y, Okamura T, Nakamura K, et al. The clustering of cardiovascular disease risk factors and their impacts on annual medical expenditure in Japan: community-based cost analysis using Gamma regression models. BMJ Open. 2013;3:e002234. https://doi.org/10.1136/bmjopen-2012-002234.
22.
Nkemdirim Okere A, Moussa RK, Ali A, et al. Development and validation of a tool to predict high-need, high-cost patients hospitalised with ischaemic heart disease. BMJ Open. 2023;13:e073485. https://doi.org/10.1136/bmjopen-2023-073485.
23.
Arrow KJ. Uncertainty and the evaluation of public investment decisions. Am Econ Rev. 1970;60(3):364–78.
24.
Mihaylova B, Briggs A, O'Hagan A et al. Review of statistical methods for analysing healthcare resources and costs, Health Economics, John Wiley & Sons, Ltd.2011;20(8):897–916. https:///doi.org/full/10.1002/hec.1653
25.
Ruíz SJ, Montesinos López OA, Ramírez GH, et al. Generalized Linear Models. Generalized Linear Mixed Models with Applications in Agriculture and Biology. New York (NY): Springer; 2023.
26.
Kern DM, Wasser T. Analysis of health care costs containing a large proportion of $0 data using traditional and zero-inflated gamma regression models. Value Health. 2013;16(3):A21.
27.
Williford E, Haley V, McNutt LA, et al. Dealing with highly skewed hospital length of stay distributions: The use of Gamma mixture models to study delivery hospitalizations. PLoS ONE. 2020;15(4):e0231825. https://doi.org/10.1371/journal.pone.0231825.
28.
Eckardt M, Brettschneider C, van den Bussche H, et al. Analysis of health care costs in elderly patients with multiple chronic conditions using a finite mixture of generalized linear models. Health Econ. 2017;26(5):582–99.
29.
Chen J, Vargas-Bustamante A, Mortensen K, Thomas SB. Using quantile regression to examine health care expenditures during the Great Recession. Health Serv Res. 2014;49(2):705–30. https://doi.org/10.1111/1475-6773.12113.
30.
Reserve Bank of India. Reference rate archive. [Available from https://www.rbi.org.in/scripts/referenceratearchive.aspx]
31.
Ministry of Labour & Employment. Government of India. Annual report 2023. https://labour.gov.in/annual-reports
32.
Radhakrishnan M, Nagaraja SB. Modified Kuppuswamy socioeconomic scale 2023: stratification and updates. Int J Community Med Public Health. 2023;10(11):4415–8.
33.
Malehi AS, Pourmotahari F, Angali KA. Statistical models for the analysis of skewed healthcare cost data: a simulation study. Health Econ Rev. 2015;5:11. https://doi.org/10.1186/s13561-015-0045-7.
34.
Xu M. Quantile Regression Model and Its Application Research. Acad J Sci Technol. 2023;8(3):172–6.
A
35.
Cleveland WS. Robust locally weighted regression and smoothing scatterplots. J Am Stat Assoc. 1979;74:829–36.
36.
Chauhan AS, Mukherjee K. Economic burden of coronary heart disease in North India. Int J Noncommun Dis. 2016;1(1):18–25.
37.
Karan A, Engelgau M, Mahal A. The economic implications of non-communicable disease for India (English). Health, Nutrition and Population (HNP) discussion paper Washington, D.C.: World Bank Group. (2010) http://documents.worldbank.org/curated/en/488911468041673131/The-economic-implications-of-non-communicable-disease-for-India
38.
Huffman MK, Rao KD, Pichon-Riviere A, et al. A Cross-Sectional Study of the Microeconomic Impact of Cardiovascular Disease Hospitalization in Four Low- and Middle-Income Countries. PLoS ONE. 2011;6(6):e20821. https//doi.org/10.1371/journal.pone.0020821.
39.
Gheorghe A, Griffiths U, Murphy A, et al. The economic burden of cardiovascular disease and hypertension in low- and middle-income countries: a systematic review. BMC Public Health. 2018;18(1):975.
40.
Sheikhgholami S, Ebadifardazar F, Rezapoor A et al. Social and Economic Costs and Health-Related Quality of Life in Patients With Acute Coronary Syndrome, Value in Health Regional Issues. 2021; 24: 123–9 https://doi.org/10.1016/j.vhri.2020.11.002
41.
Gregori D, Petrinco M, Bo S, et al. Regression models for analyzing costs and their determinants in health care: an introductory review. Int J Qual Health Care. 2011;23(3):331–41.
42.
Pourhoseingholi A, Pourhoseingholi MA, Vahedi M, et al. Relation between demographic factors and hospitalization in patients with gastrointestinal disorders, using quantile regression analysis. East Afr J Public Health. 2009;6(suppl 1):45–7.
43.
Sherwood B, Wang L, Zhou XH. Weighted quantile regression for analyzing health care cost data with missing covariates. Stat Med. 2013;32(28):4967–79.
44.
Prakash B, Jaiswal A, Shah MM. Demographic & angiographic profile of young patients aged 40 year & less undergoing coronary angiography in a tier II city of Eastern India. J Family Med Prim Care. 2020;9(10):5183–7. https://doi.org/10.4103/jfmpc.jfmpc_1063_20.
45.
Mohammadpour S, Niknam N, Javan-Noughabi J et al. The Factors Associated with Direct Medical Costs in Patients With Gastric Cancer: Quantile Regression Approach Compared With Gamma Regression, Value in Health Regional issues, 2020;21:127–32, https://doi.org/10.1016/j.vhri.2019.08.479
46.
Austin PC, Ghali WA, Tu JV. A comparison of several regression models for analysing cost of CABG surgery, Statist. Med. 2003;22:2799–815. https://doi.org/10.1002/sim.1442.
47.
Hu L, Li L, Ji J et al. Identifying and understanding determinants of high healthcare costs for breast cancer: a quantile regression machine learning approach. BMC Health Serv Res.2020;1066 https://doi.org/10.1186/s12913-020-05936-6
48.
Lo T, Parkinson L, Cunich M, et al. Factors associated with higher healthcare costs in individuals living with arthritis: evidence from the quantile regression approach. Expert Rev Pharmacoecon Outcomes Res. 2015;15(5):833–41.
49.
Zhao Y, Atun R, Anindya K, et al. Medical costs and out-of-pocket expenditures associated with multimorbidity in China: quantile regression analysis. BMJ Global Health. 2021;6:e004042. 10.1136/bmjgh-2020-004042.
50.
Olsen MA, Tian F, Wallace AE, et al. Use of Quantile Regression to Determine the Impact on Total Health Care Costs of Surgical Site Infections Following Common Ambulatory Procedures. Ann Surg. 2017;265(2):331–9. https://doi.org/10.1097/SLA.0000000000001590.
Click here to Correct
Click here to Correct
Click here to Correct
Abbreviations:
CAD
Coronary artery disease
MT
Medical therapy
CAG
Coronary angiography
PTCA
Percutaneous transluminal coronary angioplasty
CABG
Coronary artery bypass graft
1
Available from https://transport.delhi.gov.in/sites/default/files/Transport/circulars-orders/output.pdf
2
Available from https://www.rbi.org.in/scripts/referenceratearchive.aspx
Total words in MS: 5624
Total words in Title: 23
Total words in Abstract: 247
Total Keyword count: 4
Total Images in MS: 3
Total Tables in MS: 7
Total Reference count: 50