The castle built by William de Warren, one of the most ardent supporters of William the Conqueror, was originally only a large fortified stone house. The keep was built during the civil wars of the 1140s.