Officially, the Charles Edward Leverett House is listed to have been built around the year 1800. However, some say that the construction of the house happened before the 1800s. Some even claim that it could have been constructed prior the Revolutionary War, but there are no records to prove such, which is common among the old houses in Beaufort, South Carolina.

According to evidences, however, the house was built in the early 1800s. As to where it was initially built, debates still follow. Some say that it was built in St. Helena Island and was just moved by Dr. Benjamin Rhett to its location on Bay Street during the 1850s. In any case, the house was purchased in 1854 by Charles Edward Leverett, the last rector of the Old Sheldon Church.

The Charles Edward Leverett House stayed in the Leverett family until 1920, thanks to Charles Edward Leverett?s successful reclamation of the property after the Civil War.