The caves are probably open if you can get through the front gate. There are other caves outside the front gate if the gate is closed.
Watch your head on the top.
Pretty sure they are but even if not, lots to see.
Thanks! Your answer is awaiting moderation.