What started as a fun game that gave me Portal vibes almost immediately turned into an irritating mess cobbled together for non-VR systems.

This game does not give you any pointers or tell you what to do so you spend most of it walking around trying to see if anything sticks out (and they usually don't).
I gave up on this once I was let at the TARDIS controls because I wasn't told what to do in order to use them and I spent like ten minutes pushing buttons just to get told "Try again!"
What am I doing?
Why am I failing?

No idea.