Analyzing treatment effects in real-world multicenter data poses substantial methodological challenges, particularly when treatment assignment is highly imbalanced and confounding is severe. This study aimed to demonstrate the implementation, performa...
Analyzing treatment effects in real-world multicenter data poses substantial methodological challenges, particularly when treatment assignment is highly imbalanced and confounding is severe. This study aimed to demonstrate the implementation, performance characteristics, and practical considerations of four propensity score (PS)–based methods—matching, stratification, inverse probability of treatment weighting (IPTW), and covariate adjustment—using an observational dataset of patients with aneurysmal subarachnoid hemorrhage. Data from a prospective multicenter registry were analyzed. PSs were estimated via logistic regression incorporating demographic, clinical, and center-specific covariates. Four PS-based approaches were applied: nearest-neighbor matching with multiple ratios and caliper widths to optimize covariate balance; stratification using exposed-based strata with varying numbers of quantiles to control for confounding; IPTW with stabilized weights and multiple trimming procedures to mitigate extreme propensity values; and covariate adjustment including the PS, with and without additional temporal covariates. Across all methods, treatment effects on delayed cerebral ischemia (DCI) were estimated with adjusted odds ratios (ORs), 95% confidence intervals (CIs), and p-values, and covariate balance was assessed using standardized mean differences. Effect estimates varied with methodological choices. PS matching ORs ranged from 0 to 1.09 depending on matching ratio and caliper, with reduced sample sizes limiting precision. Stratification produced consistent but imprecise estimates (ORs 0.75–0.79), while IPTW results were highly sensitive to trimming strategy (ORs 0.46– 1.85). Covariate adjustment yielded similarly wide CIs. None of the four methods demonstrated statistically significant associations. This study illustrates the practical limitations of PS-based methods in low-incidence, heterogeneous multicenter observational datasets. Method selection, balance diagnostics, and sensitivity analyses are critical for valid causal inference when dealing with extreme PS distributions, sparse strata, and small sample sizes.