According to Henri Bodin, the château was built on the site of the former oppidum of the Gauls, the square towers of which, and the way they were placed on the ramparts, inspired the builders of the château. It is this particular facet of its construction that allows the château to be dated to at least the 11th century. (Some historians think that it could date from before the building of the church).
Surviving buildings include the prison, with its two vaulted cells lit by a loophole.The château was besieged and conquered in 1207 by Philippe Auguste.On the 22nd September 1565, Jean Ysoré, the lord of Airvault, had the honour of receiving Charles IX and the young prince of Navarre (the future King Henri IV) at the château.