PORT GIPSON, Miss. (WJTV) – One of Mississippi’s historic churches was vandalized on Tuesday, January 31.

First Presbyterian Church in Port Gibson is widely known for its steeple with the hand pointing toward heaven.

According to church leaders, someone came into the church on Tuesday, overturned the pews, tipped the pulpit backwards, overturned the baptismal font and communion table, and damaged the piano and organ. They said the vandal also damaged two of the 120-year-old-stained glass windows.

The church is normally left unlocked everyday for tourists to visit.

Claiborne County Sheriff Edward Goods said Arthur Washington, Jr., was arrested in connection to the case. He was charged with destroying public property, church building, or certain cemetery items.

His initial appearance was on February 2. He was denied bond.