Whittington Church stands on an ancient site of a motte and bailey castle. It is believed there has been a church on this site since the year 1200. In the churchyard many old stones can be seen dating back to Norman times. The tower is the oldest part, built in the 15th Century and the height is fifty feet. Fragments of stones in the doorway are reputed to go back to the time of William the Conqueror. Apart from the Tower, the external appearance of the church is Gothic, and this is due to the fact that major restoration took place in 1875.
To the west of the church there is a mound which may have been a Norse moothill (meeting place), and possibly a place where the Saxon earl would have held court over local affairs. On this there is now a sundial on a square base of five steps, which may have been the steps of a cross.