Built in 1854, the First Presbyterian Church goes way back to the late 1700s historically. Its congregation was actually formed in 1795 and its first church was completed in 1813, now known as the Jackson Hall. The current building is actually a replacement of the earlier one.

Described as a fine example of English Gothic architecture, the First Presbyterian Church is actually one of the city?s most distinguishable architectural landmarks. It is located on a lot where it once shared a graveyard with the local Episcopal congregation.

The First Presbyterian Church is a member of the Associate Reformed Presbyterian Church. Its cemetery is also the resting place of notable figures like Henry William de Saussure and Woodrow Wilson. It was also listed on the NHRP in 1971.