Add option to summarize failure output

[panuhorsmalahti]

Thanks, :+1:.