We just walked in when we went but I would think if it was a huge act or a weekend you should book something before hand. We went on a Sunday night on the last night of the group's 5 night series so we were able to get a seat at the bar but it was still pretty busy.
Both times I've been we just walked in.
Thanks! Your answer is awaiting moderation.