In this post we continue with soft thresholding. Our estimator is an optimal solution (unique due to strong convexity) to

and the observation model is note that we included the noise variance in . We are interested in how the loss of compares with ‘the oracle’ the loss for which is zero. We will assume that the signal is sparse; specifically, its support is with