The Bull Inn was located to the southern and eastern sides of the present Butter Market, which was once, during the 12th to 14th centuries, 'The Bullstake', where a large stake placed in the centre of the square to which animals were tied and baited. The name 'The Bull' or 'The White Bull' goes back at least one hundred years earlier, given to the 'great stone house' on the site, built by the Priory at the end of the twelfth century.