Dynamic Model Specialization for Efficient Inference, Training and Supervision