If you know the names of the (free) owners of the property during the Civil War, then the 1850 and 1860 slave censuses should be a pretty good indicator
I'm honestly not sure myself but I guess you could start by looking for any sort of deed, asking the people you bought the house from or the original owners if at all possible...researching the area online could yield results perhaps.
Thanks! Your answer is awaiting moderation.