Cheryl, 31, confessed that 55-year-old Simon is driving her crazy with 3am phone calls about the show.
X FACTOR'S JACK WALTON ON HIS MUM'S LESBIAN AFFIAR: "IT WAS A LOT TO TAKE"
She told a UK newspaper: "Simon likes to call at three in the morning. He is there and thinking about the show and thinking about pyrotechnics."
Things have gotten so bad between Cheryl and Simon that she even wants to switch seats.
"I think Louis should sit next to him and I should sit next to Mel," she said.
Cheryl also spoke of her discomfort over the six-chair challenge. She said: "I'm like 'this is all my responsibility now'. I wasn't ready for that feeling, it's very intense because you have people's dreams on the line and their feelings. I go home and I can't sleep."
SIMON COWELL 'FURIOUS' WITH MEL B OVER FLEUR EAST CHEATING CLAIMS
During Saturday night's show, Simon commented that Cheryl's green Lanvin dress made her look like Kermit the Frog.
Hitting back, Cheryl said: "I loved the dress, it was such an obvious thing to say because it was green.
"Simon looks like Zig and Zag! Remember the last time I wore that dress with the discs? As soon as I sat down he looked at me thinking 'What the bloody hell do you have on?'"