“I’m asking much more directly, and I’d just really appreciate a straight answer to this,” Gorsuch said at one point.