Towards Safe and Efficient Learning for Dexterous Manipulation