Nonparametric Empirical Bayes Confidence Intervals
TLDR
This paper introduces Nonparametric Empirical Bayes Confidence Intervals (NP-EBCIs) for individual effects, offering improved inference with asymptotic exactness.
Key contributions
- Proposes Nonparametric Empirical Bayes Confidence Intervals (NP-EBCIs) for individual effects.
- NP-EBCIs are asymptotically exact, with conditional and marginal coverage converging to nominal.
- Demonstrates posterior quantiles inherit ill-posedness, leading to a logarithmic estimation rate.
- Simulations show NP-EBCIs maintain coverage and reduce length compared to isolated methods.
Why it matters
This paper is important because it offers a robust method for constructing confidence intervals for unobservable individual effects. By borrowing strength across units, NP-EBCIs provide more accurate and shorter intervals than traditional methods, even with the challenge of slow asymptotic rates.
Original Abstract
Empirical Bayes methods can improve inference on unobservable individual effects by borrowing strength across units. This paper proposes nonparametric empirical Bayes confidence intervals (NP-EBCIs) for unobservable individual effects in a normal means model. The oracle intervals are constructed from posterior quantiles under a point-identified, fully nonparametric prior; feasible intervals replace these quantiles with nonparametric estimates. The NP-EBCIs are asymptotically exact in the sense that both their conditional and marginal coverage probabilities converge to the nominal level. The flexibility of this nonparametric construction has an unavoidable statistical cost. We demonstrate that posterior quantiles, unlike posterior means, inherit the severe ill-posedness of nonparametric deconvolution: the minimax optimal estimation rate is logarithmic. This logarithmic rate is minimax optimal for errors in the conditional coverage probability, and the resulting errors in the marginal coverage probability also vanish at the same logarithmic rate. Despite these slow asymptotic rates, simulations show that the NP-EBCIs remain close to nominal coverage when the prior is non-Gaussian, and deliver substantial length reductions relative to intervals that treat each unit in isolation.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.