If speed isn’t related to power…

[SSJ2]

I also think that Goku wouldn’t be suppressing himself if Ginyu was displaying 120k power. You can argue he was holding back, but Goku would still sense he was at a tremendous disadvantage.