Beyond Convexity: Robustness and Optimality in the Gaussian Sequence Model