As already stated, Whis stomps. With recent reveals, Broly is probably the only one here stronger than Beerus (arguably in the anime continuity at least and definitely in the manga continuity) and Whis is at bare minimum 1.5x Beerus. Whilst the team may have the chance of overpowering him together, it's not going to happen. Whis is far more skilled than all of them combined, Broly lacks the rationality to be a team player and both Jiren and MUI Goku have stamina issues. Add in SSB Vegetto having the same issue and nothing will really change.
Remove the stamina problems and Whis may find this difficult, though his skill would probably still allow him to pick off each fighter one by one.