Irish ayes turned to nays yesterday for Mayor Bloomberg at the St. Patrick’s Day Parade.

Sporadic boos and catcalls greeted the mayor as he marched up Fifth Avenue, a pointed reminder that a joke he told last month about “inebriated people” hanging out the windows of the American Irish Historical Society was taken by some as an insult.

“Bloomberg — You’re a Drunk,” proclaimed a sign held aloft by Dennis Dunn, who painted his face in the colors of the Irish flag and wore a coat festooned with Irish buttons.

“He did it as a joke, but the Irish community doesn’t take it as a joke,” fumed Dunn.

Bloomberg spent four hours at the march and then headed to the American Irish Historical Society, scene of his controversial quip.