The tail seems to be more of something that aids Goku's balance rather than outright increasing his strength and speed, since it doesn't really make much sense for a tail's regrowth or loss to drastically increase or decrease strength when considering later parts of the franchise such as Goku being prepared to beat Grandpa Gohan after losing his tail, Vegeta being confident in being able to kill the Dragon Team after his defeat on Earth or Baby outright stating Galu regrowing his tail didn't increase his power at all if wanting to count GT. Breaking walls was a feat inferior to some Goku and Yamcha showcased in the previous arc and Kuririn was capable of breaking through a wall during the preliminaries, so Giran's surrender likely had more to do with Goku's resilience in being able to do that after having also taken a beating from him and breaking out of his Guru Guru Gum. Against Silver, he doesn't show any moves in which his tail would aid in his abilities, unlike his jumping kick against the wall, so I doubt his moves against Silver were more potent.