Justice Samuel Alito is rejecting calls to step aside from Supreme Court cases involving former President Donald Trump and Jan. 6 defendants because of the controversy over flags that flew over his homes.

In letters to members of Congress Wednesday, Alito says his wife was responsible for flying an upside down flag over his home in 2021 and an “Appeal to Heaven” flag at his New Jersey beach house last year.

Neither incident merits his recusal, he wrote.

“I am therefore duty-bound to reject your recusal request,” he wrote.