The bath houses should be open whenever the park is open. You can call the phone number on the park website: www.dnr.maryland.gov/publiclands/Pages/southern/sandypoint.aspx
They have porta potties all over inside the bay
I saw porta potties when I was there for the light on the bay.
Thanks! Your answer is awaiting moderation.