Thanks Aaron!
Improving Deep Learning will definitely take a combination of creativity and engineering.
An example of this would be the conception of GANs (Generative Adversarial Networks) which is a combination of game theory and Deep Learning.
Sometimes the best solutions come from looking elsewhere.