Abstract
We consider the horseshoe estimator due to Carvalho, Polson and Scott (2010) for the multivariate normal mean model in the situation that the mean vector is sparse in the nearly black sense. We assume the fre- quentist framework where the data is generated according to a fixed mean vector. We show that if the number of nonzero parameters of the mean vector is known, the horseshoe estimator attains the minimax ℓ2 risk, pos- sibly up to a multiplicative constant. We provide conditions under which the horseshoe estimator combined with an empirical Bayes estimate of the number of nonzero means still yields the minimax risk. We furthermore prove an upper bound on the rate of contraction of the posterior distri- bution around the horseshoe estimator, and a lower bound on the poste- rior variance. These bounds indicate that the posterior distribution of the horseshoe prior may be more informative than that of other one-component priors, including the Lasso.
Original language | English |
---|---|
Pages (from-to) | 2585-2618 |
Number of pages | 34 |
Journal | Electronic Journal of Statistics |
Volume | 8 |
Issue number | 2 |
DOIs | |
Publication status | Published - 2015 |
Keywords
- Bayesian inference
- Empirical bayes
- Horseshoe prior
- Normal means model
- Posterior contraction
- Sparsity
- Worst case risk