And on one occasion, an unexpected – and pretty funny – incident took place involving Kyra Sedgwick, which led to the police being called out.
The Call Your Mother star recalled the time she accidentally caused a stir at the former couple's home during an appearance on The Drew Barrymore Show last week.
VIDEO: Nicole Kidman shares glimpse inside Australian home
The mother-of-two told host Drew that she was at Nicole and Tom's home with her husband Kevin Bacon, and did a little snooping around.
At one point, Kyra discovered a button underneath the fireplace mantle, and curiosity got the better of her.
"I was like, 'Oh what is that little button?' So I pressed the little button because I thought maybe something interesting will happen. Nothing happened and then I got a little nervous," she recalled.
Nicole Kidman and Tom Cruise's former home had a panic button
After making Tom aware of what she had done, he replied: "'That's the panic button.' And so the cops came, they had to stop the screening, they had to see Tom…. I think there were more than like five cop cars, it was something. I didn't get invited back," she said.
Nicole and Tom split their time between LA and London during their marriage from 1990 to 2001.
During this time, the couple adopted two children, Isabella and Connor, who spent a lot of their childhood in the UK.
The Big Little Lies star with children Bella and Connor Cruise
Nicole previously opened up about their upbringing during an interview in Vanity Fair. "Bella lives just outside London. You know, she really feels more English. We lived there for Eyes Wide Shut, Mission Impossible and The Portrait of a Lady. They both had English accents when they were little," she explained.
The Big Little Lies star went on to marry Australian singer Keith Urban in 2006 after meeting the following year.
Kyra Sedgwick accidentally pressed Nicole and Tom's panic button during a dinner at their home
The celebrity couple are doting parents to daughters Sunday and Faith.
Tom, meanwhile, was married to Katie Holmes from 2006 to 2012. During this time, the pair welcomed daughter Suri, now 15.
Read more HELLO! US stories here
Like this story? Sign up to our newsletter to get other stories like this delivered straight to your inbox.