Per the orthogonality thesis (Bostrom) I do not even expect AI to have similar moral values to ours.
I expect it to instrumentally secure power to better pursue it’s goals, and in the process thereof establish hegemony over us and other AIs.
From there it could easily try to kill us. I don’t want any of that.
My preferred outcome seems to be what Elon Musk wants, human cyborgs amplified with brain computer interfaces and control over machines; never a machine with control over many humans or posthumans.
