Is the Old State Capital wheelchair accessible?

Yes

There is an elevator inside for all floors.

I believe there is a side entrance and there is a direct elevator access from the underground parking garage.

Not at the main entrance, but they do have a side entrance, but you should check before you go to make sure they are able to accommodate the wheelchair