[ExI] Just some thoughts, nothing new really

[Rafal Smigrodzki]

On Fri, May 10, 2019 at 10:24 AM Dave Sill <sparge at gmail.com> wrote:

>
> I'm not sure how you go from a world of wild humans to a world of man made
> Good People, but we're a way off being able to create Good People. And a
> single Bad Person could easily take over a planet full of Good People.
>
> ### Actually I am thinking here about the impact of AI on wild type
humans. Soon it will be possible to generate new designs of minds, not
evolved to survive as operating systems for self-replicating meat
creatures. Our minds are indelibly shaped by our history (as you mentioned)
and there are only a few designs that could evolve inside a monkey. A mind
designer will be able to explore a much wider design space, including
designs well-suited for selfless cooperation, lacking the drive to
self-replicate, completely transparent, cognitively specialized, always
cooperating within in-group, or never cooperating with out-group.

A group of such perfect cooperators would have an incredible advantage over
groups of wild-type humans, who are very imperfect cooperators. While
exhibiting the characteristics we applaud in our fellow humans
(selflessness, transparency, cooperation) these Good People would be very
bad news to anybody trying to oppose them. Contrary to what Dave suggested,
psychopaths and other non-cooperators would not be able to take over - the
new society would be resistant to take-over due to designed features, such
as transparency, selfless punishment of defectors, and others.

One of the most important features of the Good Society would be externally
controlled replication of minds. Where we replicate based on internal cues
(much disturbed by modern living, but that's a different story), the Good
People would only be made as needed to fulfill their societal roles,
assuring an efficient structure of the society. Mind-factories would churn
out enough engineers, teachers, menial workers, accountants and whoever
else is needed to meet demand.

We wild type humans might have to eke out an existence at the margin of the
Good Society, not necessarily worse off in absolute terms but completely
subordinate to the cooperators.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20190510/ea24b37a/attachment.htm>