We dont have a room or reservation, can we stop by just for dinner?

Yes

You don't need a reservation and you can come in but I wouldn't it's mean to take kids to a cool hotel and when they see a giant water park and lights from the arcade you should stay there as you arnt Aloud to use the water park or arcade without a room booked

Does cost extra for water park if staying hotel?

Yes no reservation needed