I've been up both Clipstone and Annesley, Annesley was very rotten, yet still easy to repair as it was a small structure, Clipstone is massive, the actual structure itself is fine, it's just the rotten stairs (and lack of safety rails) that is the concern, though I doubt that if they were restored, people would climb them.