So this was quite impressive.
They did this live. Now imagine if you applied this system applied to your animated characters. You could create an anime quite quickly.
Here is how to do it.
Personally I think you could use this for head animation and then use something else for the body like 3d cellshaded to match the head.