First, he convinced former scorned judge Cheryl Cole, 30, to return after her sensational sacking from The X Factor USA.
READ: MEL B APPEARS TO ADDRESS 'LESBIAN ROMP' CLAIMS: "WHAT'S THE POINT IN REGRETS?'
Then he forked out a reported £1million to secure former Spice Girl Mel B, 39, as the fourth judge, after months of speculation.
But now it has been reported that joining Cheryl and Mel, along with him and Louis Walsh, 61, there will be a fifth judge for the ‘wildcard’ category.
READ: CHERYL COLE ON MARRIAGE SPLIT, X FACTOR DROP AND MORE: "I THOUGHT I HAD EVERY BOX TICKED...THEN THE RUG GOT PULLED OUT FROM UNDER ME"
As well as the usual categories – boys, girls, groups and the over-25s – there are talks of their being a new fifth category for ‘novelty’ acts. Think Wagner.
Along with the added category, it is thought that Si will also splurge on a star judge to mentor them, and Rita Ora and Mary J Blige are reportedly in the frame.
A source told the Metro: “Simon Cowell is planning on introducing a wildcard category which will be mentored by a mystery fifth judge.
READ: IS VICTORIA BECKHAM JOINING MEL B FOR THE X FACTOR JUDGE'S HOUSES?
“There was a creative meeting three weeks ago and plans are now being put into action. A fifth judge will prevent the deadlock and add some spice to the panel during live shows.
“Rita Ora and Mary J Blige are currently in discussions with show bosses.”
Do you think a Wildcard round will be a good addition to the line-up? Comment below, tweet us at @closeronline and let us know your thoughts.
You may also like The X Factor runners-up who have done better than the winners!