End turn problem

Hi,
I can't figure out how to end a turn when I've completed all the tiles and upgrades on a planet.
The end turn button is replaced by the planet button, but I've found no way to let the system know that I've done with the building there.
nly way I've found is to destroy an upgrade and build it again, to make the planet button go away and the end turn button appear.