The present house dates from the early 1500s.

In 1812 the estate passed to Henry William, son of Henry. He was created Marquess of Anglesey, in 1815, for his heroism at the Battle of Waterloo, where he lost a leg. His artificial leg remains in the house to this day as part of an exhibition!

The fifth Marquess converted the chapel into a private theatre in about 1900, but apart from that, no major alterations were done for 30 years. In the 1930s, the sixth Marquess removed the battlements from the parapets, shortened and added Tudor caps to the two pinnacles in the east front.

At the same time, he completely remodelled the north wing, destroying the chapel/theatre. He also created the long dining room on the ground floor.

The dining room on the ground floor houses what is the most famous of Rex Whistler's works. A 58-foot-long mural on canvas, painted in the trompe-l'oeil style. Stunning in its complexity, it includes Italian buildings, a triumphal arch, and the family bulldogs. , The young man sweeping up leaves at the far end of the mural is a self portrait, and was the last painting of the great man before his untimely death.