Dax Shepard and James CaldwellKristen Bell are keeping their love life to themselves.

Despite any speculation about their personal life, the longtime couple—who share daughters Lincoln, 11, and Delta, 9—don’t intend on bringing any other couples into the mix.

“The most exciting tabloid story was that we were Hollywood swingers,” Dax said of himself and the Frozen star on the Sept. 9 episode of The Drew Barrymore Show. “We were swingers and we hosted swing parties. This was in the tabloids.”

However, the rumors also led to Dax and Kristen’s pals having some fun.

“My favorite part of that happening was we got a lot of texts from other friends of ours saying, ‘How could you not have invited me to the swinger party?’” the 49-year-old quipped. “And they were joking, of course, because they know us, and they know we’re not hosting swinger parties. It was great to receive a text from [Jimmy] Kimmel saying, ‘My feelings are quite hurt that Molly and I weren’t invited to this swingers party.’”

And to fully set the record straight, the Armchair Expert cohost added, “There’s a lot of hot couples out there, but we haven’t crossed that divide with anyone.”

So who does the couple, who tied the knot in 2013, consider their own couple goals?

“You know who we’re most in love with, we’re in love with Ted Danson and Mary Steenburgen,” he said of the veteran Hollywood pair. “They’re so dreamy as a couple. You just kind of want to be in their marriage.”