There are few certainties in life and one of them is that you don't say no to a diva, especially when her name is Mariah Carey. The 'X Factor' producer and judge Simon Cowell has revealed to PEOPLE that he is frantically working on a way to incorporate the new mom of twins and high octave singer into the show.

Cowell revealed that Carey has wanted in on the show from the get-go, saying Carey "wanted to be involved in the show from day one." There were early rumors that Carey would sit on the judging panel with Cowell, but it would seem that her recording schedule and the fact that she now has two infants at home might make committing to the show's grueling taping schedule a bit difficult. Cowell eventually filled out the panel but he is willing to make concessions to accommodate Carey because, well, she's Mariah Carey! There has to be some other way to involve her in the show.

"You can't say no to Mariah," Cowell said. "We have to find a role for her. I'm a huge fan of hers – not just as an artist, but as a person, and I love her to death."

With his signature cheeky British humor, Cowell joked that incorporating Carey into the show will be tricky. "We just can't shut Paula [Abdul] and Nicole [Scherzinger] up," he said. "Add Mariah into the mix as well and you won't even have anyone singing."

Let's see how creative Cowell can get with finding a way to make Mariah Carey a part of 'X Factor,' which debuts Sept. 21. While Carey can hire an army of nannies to help care for Monroe and Moroccan, she's not the kind of diva to just half-ass being a parent or a reality TV show panelist.

We're looking forward to seeing how this shakes out for Cowell and Carey. Having Carey on the show would give the show a shot of cred and ratings out of the shoot.