It sounds like Brad Pitt is going to have a lonely Father’s Day, as a new report claims his children are planning to spend it with their mother, Angelina Jolie, instead of him.

This comes after it was revealed his three daughters have dropped his last name from theirs, opting to only use the surname Jolie.

Brad’s Kids Believe Angelina Raised Them

Sources told In Touch that Brad’s kids feel like they were raised primarily by Angelina, so it feels right to celebrate the holiday with her over him, especially considering the exes’ are still engaged in a bitter custody battle over t heir minor children.

Earlier this month, it was reported his daughter Shiloh removed Pitt from her last name, which was originally hyphenated, apparently following in the footsteps of her sisters Vivienne and Zahara. “Brad was blindsided by Shiloh dropping his last name, but he wasn’t surprised,” a source told the publication of Brad’s reaction. “

“He feels that Angie has slowly but surely turned their kids against him. She absolutely influenced their decisions to distance themselves from their dad,” they went on.

Speaking to PEOPLE, another source echoed a similar sentiment. “He’s aware and upset that Shiloh dropped his last name. He’s never felt more joy than when she was born. He always wanted a daughter,” they shared. “The reminders that he’s lost his children, is of course not easy for Brad. He loves his children and misses them. It’s very sad,” the source added.

Brad Wants To Have More Kids

Despite Brad Pitt’s disappointment over the current state of his relationship with his children, sources indicate that he is considering expanding his family with his girlfriend, Ines de Ramon.

“Brad wants another chance at fatherhood,” an insider shared with In Touch. “He’s a different person than the first time around.”

Earlier this year, reports similarly suggested that Pitt is enthusiastic about starting a family with Ines, especially now that her divorce from Vampire Diaries star Paul Wesley has been finalized after several years of legal battles. This is a situation Pitt can relate to, given his ongoing disputes with Angelina Jolie.

“Their court battle is finally winding down, and extending an olive branch to Angelina is the right thing to do,” another source told Life & Style . “His goal is to have his kids see him and Angie get along. He’s putting their family first.”

A different source told Closer, “Brad and Ines are smitten with each other and she recently moved into his Los Feliz mansion, proving how serious they are.” They added, “He’s known from the outset that Ines wants to become a mum and that’s something they discussed very early on, given their 30-year age gap.”

The insider elaborated that Ines is taken aback by Brad’s readiness to embrace fatherhood again, but he has assured her that it’s something he genuinely desires as well.

“After everything he’s been through with his children, he’s keen to make a fresh start and create new memories,” the source emphasized. “Brad’s not getting any younger, so it’s something they would like sooner rather than later. He’s even joked about doing the school run in his 70s and hopes that he’ll still be seen as a heartthrob!”

For now, Pitt hasn’t commented on the rumors that he wants more children.