Do they have motels by the lake or water?

Yes, many accommodations near or on the plentiful water sources.

The Arlington is across the street from Hot Springs national park, as well as numerous hotels near the lakes.

There are a few lakes right around the city. Each lake does have a number of hotels/motels on the shore, or near enough. Regarding hotels overlooking the literal hot springs, that's somewhat harder to explain.