Nothing like a little bourbon when you’re putting up a statue.

Workers removing a statue of Civil War leader Jefferson Davis from the Kentucky state Capitol in Frankfort on Saturday discovered unexpected artifacts hidden inside the base: a bottle of Glenmore Kentucky Straight Bourbon Whiskey, and a copy of the State Journal newspaper from Oct. 20, 1936, the day the statue was erected.

One local report suggested the bottle may have held a piece of paper but others said the vessel was empty.

Kentucky’s Historic Properties Advisory Commission voted overwhelmingly Friday to remove the Davis statue. Davis, a one time US senator who died in 1889, was president of the Confederate states. He was later indicted for treason but not tried.

The Davis statue is to be relocated to a state park in Davis’ birthplace of Fairview, Kentucky.