It seems it's a known issue with the One X.
It's rather noticable when using Netflix on the console rather than the app on the TV.
All the colours just wash out, you can tell when it does it, the info bar appears showing screen size, time etc.
But still, just turning it off, everything still looks fantastic.