Just in case anyone else comes across this issue of not going in to full VR mode when running, as in my case, a Unity3D build. After spending more hours than I care to admit I ended up spending a further hour wiping Windows and reinstalling everything from scratch.
And then it worked.
#Weird.