Northern Ireland Secretary Brandon Lewis defended Boris Johnson going to the party, as he'd "recently come out of hospital"