The Allis ? Bushnell House was built in 1785. The house, a one-and a half story building, was initially built with two big rooms in the front area and a small cooking area and bedroom on the back. Upstairs there were small rooms totaling 4 in number. On 1789, Elisha Mann purchased the house from Aaron Blatchley. After a week, Mann was able to sell the property to John Henderson, her father-in-law.

On January 29, 1791, Elisha Mann bought half of the estate from John Henderson, while the other half of it is registered on his name. On February 2, 1791 sold her half to Lyman Munger. He was married to Elizabeth Coe. Elizabeth Munger died on April 29, 1792. On July, 1792, John Henderson owned the entire estate. He sold it to his brother Jeheil.

In 1807, Nathan Bushnell owned the house. In 1900, Erickson Bushel is the legal owner of the house. On July 13, 1920, Madison Historical Society bought the house and the land. This was researched by Lyn Friedman, the chair woman of the Madison Historical Society.