I've never heard of it being an insane asylum but, yes it is the sight of the old tuberculosis hospital. It was later part of the south Carolina prisons system and was called Blue Ridge work release program and was a minimum security prison.
You can find some of the elements of the hospital there and also a historical marker
Thanks! Your answer is awaiting moderation.