Built during the Colonial era, the mansion stood within the stockade boundary of colonial Fort Cumberland. Artifacts dating from the French and Indian War have been found on the property. In 1843, Judge Thomas Perry began building the residence. It is one of the oldest brick structures on Washington Street. Judge Oliver Cromwell Gephart purchased property in 1875 at public auction, and soon enriched the house with many new features and additions. In 1916 the mansion was passed on to the Gephart’s daughters, Mary and Susan.

After Mary Gephart Gillette’s death, her granddaughter, Christine Gillette Piper bought the house from her estate in 1953. Christine’s main contribution was the loving and dedicated preservation of the house and gardens. She and her ancestors had lived in the mansion for 120 years.

The house was later purchased by Mrs. Jeanette Gilchrist and donated to the Cumberland Cultural Foundation for the purpose of creating a gallery, which was accomplished in 1999. Mrs. Gilchrist requested the gallery be named in memory of her husband, C. William Gilchrist, patron of the arts.