Can you go up to see the garden if you're not a guest or do you have to be staying at the hotel?

You can visit the garden without a problem. However, sometimes the garden is reserved for special events and is only accessible to invited guests.

I'm with Freddy on that answer. 👍

Yes, you can visit the garden even if you are not a guest