It's the ability of DNNs to replace feature engineering that makes them interesting. They have completely obsoleted feature engineering in object recognition in just a few short years. Have you seen the latest DNN results in translation and image captioning? I think DNNs are quickly going to surpass the state of the art in language modeling.
