That could be taken merely as a resolve boost from Luffy. Now that he's sure Robin really needs his help and is trying to save the crew, he pulled strength from his depths and pushed the buildings.
I don't see that as meaning Luffy was weakened before. Sure, he was unsure at Robin's motives...