Not very difficult to walk. You go downhill from the Inn. It is much better than paid parking, although the public parking is only $1 per hour.
Historic downtown is about a 5 to 10 minute walk up a very small inclined hill. Not very difficult but wear comfortable shoes.
Thanks! Your answer is awaiting moderation.