An algorithm based on decision trees and random forests for estimating individual treatment effects, which achieves comparable, and often better, prediction accuracy than existing methods, while substantially improving interpretability.
Abstract
In various fields, such as medicine and marketing, accurately predicting individual treatment effects holds significant promise. However, achieving reliable predictions alone is often insufficient for making informed decisions; it is equally important to understand why the treatment effect is higher for some individuals than for others. To address this two-fold challenge of prediction and interpretation, we introduce an algorithm based on decision trees and random forests for estimating individual treatment effects. Our algorithm is simple: it operates exactly like a standard random forest, but with a different splitting criterion, and requires no additional workarounds such as double machine learning or orthogonalization as used in Generalized random forests. It handles observational studies with varying treatment propensities without requiring separate estimation of the full propensity function. This is achieved by combining two splitting criteria---one targeting heterogeneity in the treatment effect, the other targeting bias correction for the average treatment effect---which together improve split point selection and automatically distinguish confounders from features responsible for heterogeneity. As a result, interpretation follows directly from the fitted tree structure itself, that is, from which features the trees split on and with which split statistics, without requiring separate post-hoc analysis. For the theoretical analysis of this algorithm, we consider a change point model with step functions for potential outcomes and treatment propensity and provide insights into the theoretical underpinnings of our approach. Simulation studies show that our simple algorithm achieves comparable, and often better, prediction accuracy than existing methods, while substantially improving interpretability.
Studying heterogeneous treatment effects has become essential in experimental and observational studies. A critical assumption for obtaining reliable treatment effect estimates is overlap, which requires that treated and control units have sufficiently similar covariate distributions. Poor overlap may limit the effecti...
The estimation of heterogeneous treatment effects is a central objective of causal inference. However, state-of-the-art algorithms to solve this task are based on machine learning principles, and thus behave as black boxes. Consequently, the identification of covariates driving heterogeneity remains a challenging and o...
Gaëtan Patinier, C. Bénard, M. Törnqvist· 0 citations
A subgroup analysis searching a trial's covariates or many prespecified subgroups often singles out a subgroup for its extremity, interpreted as if prespecified. Selection inflates the estimate; for a given selection rule, a correction removes the inflation. Two questions belong to the rule: which candidate to return,...
A direct ranking approach for conditional RMST treatment benefit in randomized trials with right-censored outcomes is proposed that combines orthogonal survival learning with pairwise ranking and may be particularly useful in precision medicine settings where treatment prioritization and patient selection are the prima...
Ling-Li Yang, Bing-Xia Wang, Tian-Long Chen et al.· 0 citations
Assessing treatment-effect heterogeneity is important in causal inference, particularly for functional outcomes where effects may vary over time and the common effect is unknown. We propose a nonparametric procedure that assesses treatment-effect homogeneity through a testable marginal implication. By comparing within-...
Yong-Zhen Feng, Jie Li, Xiao-Jun Song· 0 citations
Many business and clinical decisions depend on the conditional average treatment effect (CATE) of each of several continuous treatments that move together: advertising spend and discount levels driven by the same campaign, or drug doses adjusted in a common protocol. Several estimator families produce CATE at every que...
D. Nayak, Mohit Kumar, Prasanth Naidu Karaka et al.· Proceedings of the 35th ACM...· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduNov 6, 2026
A machine-learning approach called CheMeleon provides a practical way to develop new drugs or other molecules with much less detailed, expensive experimentation.
Learn how Google DeepMind and GovTech Singapore uses lightweight on-device Gemma models to intercept conversational scams in private chats with zero cloud data egress.