It was known for being haunted by the Witch of the Well, a ghostly entity who had been there since long before the building existed. Clara called Caliburn House "a gigantic, old haunted house on the moors [that] the dossers are too scared to doss in". It was built sometime before 1474.
In 1974, the house was owned by Professor Alec Palmer. He, along with empathic psychic Emma Grayling, were investigating the Witch of the Well and trying to learn the truth about the phenomenon. The Eleventh Doctor and Clara visited the house to help with the investigation, introducing themselves as Ghostbusters. They discovered that the Witch of the Well was actually a time-traveller named Hila Tacorien, trapped in a pocket universe, who gained her title from a reality well in the music room. (TV: Hide)