His fellow hopefuls and staff on the ITV show have allegedly stopped speaking to him because he's such a diva.
CHERYL FERNANDEZ-VERSINI SLAMS NADINE COYLE: "SHE'S FULL OF SH*T!"
A source told The Sun: "Jay might come across as a pretty likeable character on camera, but he is becoming an absolute nightmare behind the scenes.
"Eventually Simon Cowell had to step in over his row with Stevi [Ritchie]."
Ex-Royal Navy man Jay was said to have annoyed the other stars from the moment they arrived in the house, by buying furniture for his room and commenting: "I'm here the long haul".
He also complains constantly about the other acts and even the chef's cooking.
However it all became too much when he allegedly kicked off over the winners' songs.
Historically the winners of the show have always recorded a cover as their first single, but Jay apparently wanted to use an original song.
The source continued: 'He was told where to get off. He is one of the most hated contestants we've ever had."