I have a suspicion that Goku got some sort of Zenkai Power or Power Up after his fight against Hit, as that's the only way it makes sense for SSJB Goku to be stronger than Hit in Episode 104.
I've also thought about the possibility that Goku got stronger in his little training with Whis, but...