I cannot stand those compilations where they sneak in a few tracks that are not the real deal. One I remember vividly was Every Breath You Take by The Police, a greatest hits album. Everything was fine except 'Don't Stand So Close To Me', a horrific rerecording. I think they were intending to rerecord all the songs and that ended up not happening, so I should be thankful for that at least.
http://www.youtube.com/watch?v=4jSl-Lr4VuY