“If you think I’m a liar, there’s only one way to settle this,” Whibley said. “Under oath, in front of a judge”