this does sound like a cool idea imo.
i'd also like to see actual physics, like moving and shaking applied to the hands of the driver model. in vr this would add a bit more immersion imo. when you're hooning around a track and the driver model is absolutly still, it kinda kills some of the immersion for me.