Cheryl, 30, has reportedly been promised the final say on who will be sitting on the judging panel.
Simon, 54, said at the time: “When Cheryl came back we decided we’d agree together. I’m not going to put someone beside her who she hates.”
But the media mogul is apparently now insisting that Louis Walsh return to the panel - despite Chezza's misgivings over the veteran judge.
According to The Sun, Cheryl, when asked last night if 61-year-old Louis was leaving, admitted: “I would prefer another woman.”
Which seems to back up recent claims that the Girls Aloud songstress is hoping for Olly Murs and another female to join her on the panel.
X Factor sources last night insisted only Simon and Cheryl had been signed for the new series, so Louis is not guaranteed his job back.
Last night a spokesman for Louis said: “ITV and Simon have given assurances he will be back.”
But a show source said: “There’s a lot of beef between Cheryl and Louis from his days managing Girls Aloud.”
Would you like to see Louis Walsh back on The X Factor judging panel? And if not him, then who? Let us know in the Comments Box below now.