Is King Charles finally getting his way? Will Prince Andrew be leaving his royal mansion soon? For over a year now, the brothers have been fighting over the Royal Lodge estate. The former Duke of York moved into the residence back in 2003 after signing a 75-year lease during Queen Elizabeth II's reign. That means he and his family, including Sarah Ferguson, are entitled to live on the property until 2078. After King Charles took charge, he wanted Andrew out. The 65-year-old managed to avoid eviction, creating a massive rift with his older brother.