Taking approximately over three years to build, the Jemison-Van de Graaf Mansion was finally completed in 1862. The majestic Italianate structure originally served as a townhouse for Sen. Robert Jemison, Jr., who had commissioned Philadelphian architect John Stewart. Stewart, together with partner Samuel Sloan, was famous for designing the Bryce Hospital.

It was the first Tuscaloosan home to possess modern amenities such as indoor plumbing as well as gas power for lighting. In its latter years, the mansion had served as a city library before coming into the hands of the Heritage Commission of Tuscaloosa and the Tuscaloosa County Preservation Society. Both non-profit organizations ended up managing the property with a joint board. Restoration of the historic mansion soon after began and which continues until today.