Right. Goku had no access to god ki without the ritual until he trained with Whis. When he fought Beerus, he didn't get to train with Whis yet and the ritual expired. Therefore, there is no god ki. Your counterargument doesn't really go against this. Obviously, Goku could obtain Super Saiyan God...