The meta answer is just plot.
If I had to rationalize it, I would say that Pilaf researched where the site of Roshi and Mutaito's final battle against Daimao was, and deduced that the part of the ocean Roshi threw the rice cooker in wasn't far. Then he spent the next couple of years scouring the ocean because he knew only Daimao could help him defeat Galu.