This was originally the location of a chapel dedicated to Our Lady of Monserrate, which was destroyed by the great 1755 earthquake. In 1790, Gerard de Visme bought the property and built a neo-Gothic mansion, which he soon leased to William Beckford.