For me the words "who cares?" come to mind. In our daily lives we're already tracked constantly by numerous different companies in numerous different ways, so what difference does it make?
For example, the majority of people have mobile phones with all manner of apps installed, including the dreaded Facebook. Unless they're very careful with the permissions granted those apps can track your location, the apps you use, the websites you visit, your daily habits, your contacts, and a hell of a lot more besides. Most phones also have at least two cameras on them, one pointing in each direction.
Yet outrage at this (potential) invasion of our privacy is far less prevalent than that generated since this new Oculus policy was announced, and I very much doubt many people will be boycotting mobile phones anytime soon.
So in the grand scheme of things, when we can be easily tracked by phone, PC, ISP, bank account, CCTV, shop reward cards, and "smart" TVs, does it really matter that a VR headset is now going to track the games we play on it? No, not really. Big brother is out there, and we're already in full view.
(Also, for those who already have an Oculus HMD, 2023 will likely be long after we buy new hardware anyway. I was already thinking of switching brand, and it has nothing to do with privacy concerns.)