Caroline was left heartbroken ahead of the final when music manager Jack Street – who looks after superstar Sam Smith – broke off their relationship.
Writing in her new autobiography Storm In A C Cup, which is being serialised in The Sun, the X Factor host said: “As it started to fall apart, so did I.”
Caroline, 35, admitted that her heartbreak totally knocked her, making her forget the dance moves, but Pasha sympathised with her.
Revealing her anger at Jack, she continued: “He had seen me come back from losing Xtra Factor. Now I was finally finding my feet. I felt that he could at least have waited three weeks… and I wept.”
In the brilliantly-titled memoir, Caroline also opens up about her relationships with two very famous Harrys.
Addressing her time as Prince Harry’s ‘bit of rough’, Caroline said: “Once the story got out, that was it. We had to stop seeing each other.
“I was no longer Caroline Flack, TV presenter, I was Caroline Flack, Prince Harry’s bit of rough.”
One of Caroline’s most controversial relationships came when she started seeing One Direction heartthrob Harry Styles – who was 17 at the time.
Caroline, then 31, revealed how she was shocking labelled a ‘paedophile’ during her time with the singer, and said: “It began to go wrong when Harry was pictured coming out of my house one morning.
“And once that was out, it was open season. After that anyone could say anything. In the street people started shouting at me ‘paedophile’ and ‘pervert’.
“There was a moment when we just thought, s***, this has gone really dark. So perhaps we did the wrong thing, who knows.”
Storm In A C Cup is out on 22 October, and you can pre-order it here.