The prime minister was criticised over his retort to SNP leader Ian Blackford, who called on him to resign over the Partygate scandal.