James Haven discussed being there for his nieces and nephews on the ’90who10′ podcast.

Angelina Jolie’s brother, James Haven, rarely speaks publicly about his famous sister—but the older sibling recently opened up about being “protective” of her kids amid Jolie’s split with Brad Pitt.

Haven, 52, and Jolie, 48, are the children of actor Jon Voight and the late actress Marcheline Bertrand, who died in 2007 following an eight-year battle with ovarian and breast cancer. Although Voight had a falling-out with his kids (and has since reconciled with Haven), Jolie has remained close with her brother through the years.

During a recent interview on the 90who10 podcast, Haven opened up about his relationship with Jolie and her kids: Maddox, 22; Pax, 20; Zahara, 18; Shiloh, 17, and twins, Knox and Vivienne, 15.

“That’s where it all started. It started with the protection of her and then of her children, my nieces and nephews,” Haven said, of watching his sister’s divorce from Pitt play out in the media.

During this difficult time, Haven said he prioritized being present for his nieces and nephews.

“I set my life up so I can be present with whatever the situation,” he explained. “The formative years, the young adults they’re going to become, I want to be there for them, or for her, whatever she’s going through.”

Jolie’s brother reportedly worked as a full-time nanny to his nieces and nephews after the Mr. & Mrs. Smith actors called it quits. Although Haven reportedly took a step back from Jolie and her kids’ lives after a year of living with them, the brother and sister remain amicable today.

And while Jolie and Pitt’s complicated divorce has played out in the press for several years, it seems that the famous family has simply focused on finding harmony. In a September interview with Vogue, Jolie confirmed her brood required “a lot of healing” in the aftermath of the high-profile breakup, adding, “We’re still finding our footing.”