I could only see it being the case with BB if Shiryu ends up being admiral level somehow, and Aokiji still being on their side. Zoro and Sanji usually end up eclipsing their opponents by the end of the fight.
Although I don't know how Zoro can have a tougher fight against Shiryu compared to Mihawk, even with DF shenanigans lol.