Is climbing the buildings or the rocks allowed?

You cannot climb on the mansion, but you can on the forts

Yes but not everywhere. There are fenced off sections for your safty.

Yes but probably not in bad weather. We do it all the time, or did. It's been a while

I don't think so. It was raining hard, and cold, when I went there. I still had to stop. Deserted.