Kody Says He’ll Give ‘Attention’ to Kids ‘Who Are Open to Me’

Kody Brown is setting boundaries with his children.

During the latest episode of Sister Wives, Kody and wife Robyn Brown get into an intense argument about Kody’s lack of presence in his children’s lives. Minutes into the heated exchange, Kody makes it clear that he will only put effort into the kids who respond openly to him, and only once he’s over how they’ve “shut him out.”

“Robyn, I’ll make the effort. I’ve spent a year here just lamenting the situation,” he explains. “When I get over that, those children who are open to me will get my attention.”

He then tells cameras he’s “sitting here with a broken heart” over the family members who “shut me out” and “aren’t talking to me.”

Never miss a story — sign up for PEOPLE’s free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories.

In a confessional, Robyn opens up about the differences she’s seen from the beginning of their marriage until now. “I feel like Kody was a very present dad in a lot of ways,” she says, recalling his previous actions. “Truth be told, that was what made me fall in love with Kody — seeing him be present with his kids.”

“I think that Kody should be camping out on their doorsteps and saying, ‘Hey, you’re going to talk to me,’ ” she continues. “Because sometimes that’s just what you got to do is, you know, when you care about someone, it’s just say, ‘Hey, you need to talk to me.'”

The PEOPLE Puzzler crossword is here! How quickly can you solve it? Play now!

Kody shares his opposing view in his confessional. “Some people think that parental-child relationships shouldn’t have to be reciprocal, but when they’re adults, yeah, they do,” he says, referring to his older children.

“I’m not going to reach out forever. I’m willing to make the effort, but somebody else is going to have to be on the other end of that and make some effort too,” he adds. “I’m not going to camp out on somebody’s doorstep.”

Back in the scene, Robyn makes Kody promise to keep trying with the kids who resent him to settle their dispute for the time being.

Sister Wives airs Sundays at 10 p.m. ET on TLC.