"It has been deadly, so cool," said John after Danni Minogue cast the final vote that sent them home.
Edward added: "It has been crazy but Olly deserves to go through. I hope he or Stacey go all the way."
After it was announced the boys were out, the judges gave the pair – who sung George Michael's I'm Your Man the night before - a standing ovation.
Simon Cowell, who has warmed to them over the weeks, told them: "I'm actually going to miss you." Meanwhile mentor Louis Walsh said: "I've had the best time working with them. They've made me feel young."
Olly, show favourite and former Deal or No Deal contestant, said he was "gutted" the public vote left him in the bottom two.
But a note perfect rendition of Eric Clapton's Wonderful Tonight put him through to the next round.
Britain's Got Talent sensation Susan Boyle and US diva Mariah Carey also performed on the results show.
And there were cheers as it was announced the X Factor charity single You Are Not Alone had gone to number one.