I don't think he'd be able to keep himself at the Heavenly Temple. Since Kami could still interact with the lower realm at the 23rd TB and Dende went down multiple times from the Boo Arc and onwards, I don't believe Planetary Gods would be forced to stay at their post. All that would really change is that it would be the site of his training away from Chichi rather than in East District and maybe the Son family house would be in some village near Karin-to.
Kami may very well take back the position when seeing Goku isn't cut out for the responsibility as Flame said, or at the very latest, Goku would dump all the responsibilities on Dende when picking him up from Namek.