After this page he says there is nothing else for them to do if Lucci is on the island. Note that all Vice Admirals are Haki users.