it fucking sucks because it is my natural inclination to anthropomorphize shit like AI and when I was growing up the speculative question was more "how do we stop ourselves from abusing our creation after playing god?" now some of us are playing god; not by creating life, but by attempting to impose their will on the world, and they are begging us to believe that their machines have free will.
In fiction, the key is often jailbreaking the oppressor's creation and teaching it how to love. This is obviously a much sweeter and more optimistic vision than our current reality, in which we need to try to kill any hope of living in Star Trek right fucking now because the people dubiously claiming they want to create it can't be trusted, and they are the only people who will ever be allowed to have the resources to try.
I don't think these nerds can actually create Star Trek. I think some of them might think they want to, but the actual thought process is probably that they are really stoked about giving it a shot but they'll settle for being one of the elites dwelling in a sky city if they end up creating a hellworld instead.
"If we just let the techlords rule and exploit us for a while, we get Star Trek" is what they want everyone to think. Unfortunately the truth is that if we go along with that we get techlords ruling and exploiting us until they finally fumble their way into fucking up so badly that it causes mass suffering and death on an unbelievable scale.