Is there any way to replace a bad governor with a better one?

Sometimes you pick a bad or mid level governor for a core world because that's all that is available but is there a way to replace that governor with a better one once you find one? I can't seem to find a way to do it.