Speaking on Jimmy Kimmel live, he revealed he isn't adverse to getting babysitting help, as he was largely being raised by nannies himself.
‘Can’t you just pay someone to do that?’ he said when asked if he will get up with the baby.
‘I will probably do it once or twice. I was brought up by nannies.
'I didn’t recognise my mum until I was about three or four,' he said of mum Julie, a former socialite and ballet dancer.
The 53-year-old, who arrived at the studio with ex-fiancé Mezhgan Hussainy, also opened up about Khloe Kardashian's ill-fated stint on X-Factor USA last year.
‘I liked her,’ he revealed.
‘I just don’t think the audience accepted a Kardashian as a host’.
The cut-throat show also saw Cheryl Cole and Britney Spear's judging roles cut unceremoniously short.
Speaking on the Ellen Degeneres show, the media mogul previously admitted:
'Britney was just uncomfortable. I liked her – I didn’t realize that I kind of booked someone who couldn’t talk, which is a bit of a problem when you want someone to judge.'
‘Everyone was trying to up themselves with who could find the biggest star on a panel, and we said, well, we’ll take Britney.’
This year's UK X factor panel consists of Gary Barlow, Louis Walsh, Sharon Osbourne and Nicole Scherzinger, while the US X factor panel features Cowell, Kelly Rowland, Demi Lovato and Paulina Rubio.