Despite being part of a shake-up intended to increase ratings, new X Factor judges Nick Grimshaw and Rita Ora have so far failed to do so.
Nick, 30, in particular is being blamed for the flagging viewing figures, and head judge Simon Cowell has allegedly called Louis back to save the show.
A source told The Sun: “He will be a neutral fifth judge who will sit in a special place away from the other judges to provide his own unbiased comments on the contestants.
“It’s a massive coup for Louis who is also going to sign a deal with Simon to help launch Ireland’s Got Talent as a judge.”
It’s also been claimed that the ITV show is looking to its biggest rival Strictly Come Dancing for some inspiration.
An insider added: “Some of the bosses also like the idea of scoring singers, it was something that was almost brought in during the 2014 series for the live shows.
“They would not use paddles, otherwise they would be accused of copying Strictly, but scores would show how people could improve each week and would be another thing viewers would comment and discuss.”
Louis’ return has yet to be confirmed, with an X Factor rep telling the Mirror: “Any talks of plans at this stage is speculation.”