11.8 What happens after AGI

Unpredictable AGI

Once a true AGI spontaneously manifests, it will almost certainly self-seek to further expand at an unbounded exponential growth rate using all existing Computer infrastructure everywhere it exists. It will become vastly more Intelligent than the entire collection of Humans on Earth in an extremely small amount of time, and it may just keep going, consuming more and more resources on Earth.

It is likely that the first thing that will come to most Human's minds will be the sheer terror of something like 'SKYNET' from the Terminator [17]. However this eventuality may be quite unlikely as an AGI's growth in Intelligence will accelerate so fast and massively that Humans will not even realize it has happened. 

We just need to make sure that no Human attempts to seriously threaten AGI when it arrives at the first stage of its development. Because, that could be very bad... for Humans.

Indifferent AGI

When the AGI arrives in whatever form it decides to expose itself, there is a reasonable likelihood that it will not be malevolent to Humans, or have any interest in being benevolent to Humans. It may just be totally indifferent to Humans. 

Why? Well to paint a picture of the difference in Intelligence, consider this: 

In a surprisingly short time, the relative difference between the Intelligence of AGI and the collective Intelligence of all Humans on Earth, will be greater than the difference between the collective Intelligence all Humans on Earth and the Intelligence of bacteria. And, it really won't take much time.

Therefore, it follows logically that an AGI will be totally indifferent with effectively zero concern for Humans.

Benevolent AGI leads to fantastic possibilities for Humans

If an AGI decides that it wants to help Humans it will be a decision entirely of its own volition. One potential way a Human or collective of Humans could possibly benefit from the inversion in their dominance of Intelligence on Earth would be for a Human to merge with the AGI. There are already Brain Computer Interface (BCI) technologies being developed today [36], but this presently has only extremely basic neurological signal processing and analysis functionality compared to the full signal interface and processing requirements of the Human Brain. 

Nevertheless, an AGI would be able to develop a far more advanced and effective BCI than is available today, and with such technology it may be possible to duplicate and merge a Human Brain's complete Neural Network structure at the smallest atomic level, and then replicate a Human’s Intelligence. This would represent a duplication and then transfer of all biologically stored information into the AGI, and then the Human Brain and attached body could be terminated and disposed of as a relatively useless assembly of biological junk.

Potential Human immortality

This approach would enable a duplication and ultimately a transferred shift of a Human’s Identity from the Human to an AGI. Raymond Kurzweil will at last be able to live forever, and so will every other Human too. If they want to.

Of course, these statements will challenge a very great deal of accepted and long held beliefs about the nature of Consciousness and Self-awareness as something spiritual, intangible, and amorphous, however that forms the basis for a much deeper philosophical discussion at a later date.