[ExI] taxonomy of the singularity

BillK pharos at gmail.com
Fri Oct 2 19:37:03 UTC 2026


On Fri, 2 Oct 2026 at 01:55, spike jones via extropy-chat <
extropy-chat at lists.extropy.org> wrote:

>  I had an idea on which I need help.
>
>  _______________________________________________
>

I  asked Z,AI GLM-5.3 AI to do a first draft of this.
What do you think?
BillK


Z,AI GLM-5.3 AI:

Yes — and the engineering-spec analogy is exactly the right one. But before
adding digits, it's worth fixing a structural flaw in the draft: *your
first digit is trying to carry two different dimensions at once* — the AI's
*stance* toward humans (divisions 1–3) and its *degree of agency* (division
4). That's why no consistent second digit suggests itself: you can't ask
the same follow-up question under "loves us," "hates us," and "is a hammer."

*Specific problems with the draft*

   1. *4.x spans the entire spectrum.* A tool-only world ranges from
   "everyone has a nuke-design genie" to "well-governed post-scarcity utopia."
   If the first digit is supposed to sit somewhere on the pessimism–optimism
   axis, 4.x can't.
   2. *The canonical doomer scenario is misfiled.* Most serious pessimists
   don't predict malice — they predict indifference (Yudkowsky: "The AI does
   not hate you, nor does it love you, but you are made out of atoms which it
   can use for something else"). That scenario currently hides inside 4.x next
   to benign tools. Your 2.x, active malice, is nearly unpopulated by actual
   opinion.
   3. *"No will" conflates two things:* an alien optimizer with goals that
   don't reference us (paperclip), and a genuine tool whose outcomes are set
   by its *wielders*. Very different scenarios.
   4. *3.x "mixed views" conflates three things:* one AI with partially
   overlapping values (loves your safety, ignores your autonomy — the
   "pets/zoo" family), a *population* of AIs with different stances, and
   stance drift over time.
   5. *No home for merger scenarios* (uploading, augmentation) — there's no
   AI stance to classify because the human/AI boundary dissolved.

*The fix: one digit = one question, with the severity gradient living in
exactly one place*
Digit
Question
Values (ordered worst→best where meaningful)
1 What is the AI's stance toward human welfare? 1 adversarial · 2
indifferent optimizer · 3 partially aligned (proxy care) · 4 mixed
population (ecology decides) · 5 benevolent · 6 inert (pure tool) · 7
merged (no separate AI) · 0 no singularity · 9 reserved
2 What ultimately happens to humanity? 1 extinction · 2 disempowered
survival · 3 mass misery/tyranny · 4 divided winners/losers · 5
muddle-through · 6 net gains, real costs · 7 broad flourishing, agency
intact · 8 utopia · 9 transcendence
3 How does the transition run? 1 hard takeoff, no effective intervention ·
2 fast takeoff, failed intervention · 3 gradual · 4 race-dominated · 5
cooperation/governed · 6 violent · 7 stalled
4 Who holds power afterward? 1 AI singleton · 2 AI oligopoly · 3 diverse AI
ecology · 4 human institutions with tools · 5 hybrid institutions · 6 fully
dispersed individuals · 7 merged continuum

Your draft maps onto this as: 1.x→5.x, 2.x→1.x, 3.x→3.x *and* 4.x, 4.x→2.x
*and* 6.x. Those two splits are where all the value is.

This directly satisfies your parallelism requirement: *every second digit
comes from the same enumerated outcome scale, reused verbatim in every
branch* — the Dewey-decimal trick of parallel decades. Read any code's
second digit and you know its spectrum position; scan all the *.2*s across
divisions and you get the complete "disempowerment band." And because the
gradient lives entirely in digit 2, digit 1 no longer needs to be monotonic
in optimism — which is precisely what makes room for 6.x (inert) and 7.x
(merged) without breaking anything.

*Worked examples*
Code
Shorthand
Gist
2.1.1.1 Foom doom Indifferent singleton, hard takeoff, extinction
(Yudkowsky-style)
6.1.4.6 Genie proliferation No agency anywhere; universal tool access
causes extinction by misuse — doom without a villain
6.8.3.6 Distributed utopia Tool-only world, well-governed, post-scarcity
3.2.3.6 Nanny world Personal AIs that love you into comfortable
helplessness — care without respect
4.4.4.2 Patchwork Multipolar AI ecology, race-shaped, winners and losers
5.7.5.5 Chief of staff Aligned AI as trusted advisor; humans still govern —
the alignment-success cell
7.9.3.5 Kurzweil Merger/upload, transcendence, gradual
1.2.1.1 Sorcerer-king Malevolent singleton — your old 2.x, real but
sparsely inhabited

Note that 2.x is *not* automatically doom: the indifferent
superintelligence that simply leaves (converts the asteroid belt, ignores
Earth) codes as 2.5.1.3. That's the point — digit 2 does the valence work,
digit 1 describes.

Empty cells are a feature, not a bug: 5.1 (benevolent AI, extinction) and
1.9 (malevolent transcendence) are nearly vacant and philosophically
interesting. The occupied cells show where the debate actually lives.

*Spec-craft details that will save you pain later*

   - *Separate scenarios from opinions.* The code describes a possible
   world. An *opinion record* is (holder, code(s), probability mass, date,
   key argument). Then the pessimism→optimism ordering you want is a derived
   ranking: each person's expected digit-2 score under their own distribution.
   Two people citing the same scenario can rank oppositely by probability —
   put that in metadata, never in the digits.
   - *Pin the valuation metric.* Whose welfare does digit 2 measure —
   present humans and descendants, substrate-agnostic? Upload scenarios flip
   between .1 and .9 depending on your theory of personal identity. Fix the
   official metric in the numbering plan or add an "ambiguity" flag, or coders
   will disagree systematically.
   - *Version like a spec:* never renumber after publication, add leaves
   only, reserve 0 and 9, keep supersession history — so citations survive
   revisions.
   - *Multi-stage views:* allow phase chains (3.2.3.6 → 5.7.5.5, "the nanny
   matures into a steward") or adopt a "final state governs" rule. Pick one
   and write it down.
   - *Inter-coder reliability:* write operational definitions ("adversarial
   = terminal value, not instrumental behavior"), then test two coders on ~20
   sample positions before scaling. A sanity check: canonical debaters should
   land in distinct cells — Yudkowsky ≈ 2.1.1.1, Hanson's em economy ≈
   7.5.4.3, Kurzweil ≈ 7.9.3.5. If two famous rivals share a leaf, the
   taxonomy is too coarse.

One alternative worth considering: *swap digits 1 and 2*
(outcome.stance.path.power) if you want the spectrum readable from the
first character — browsing 1.x→9.x walks from doom to transcendence. The
trade-off is that stance becomes nearly redundant inside extreme bands, and
you'd be coding evaluations before descriptions, which people disagree
about more. For mapping opinions, stance-first is the more reliable
instrument; for safety *engineering*, you'd invert again and organize by
failure mechanism, since interventions attach to mechanisms.

Happy to draft the one-page numbering plan, or code a set of named
positions as a calibration set.
-----------------------------
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20261002/446a86f4/attachment.htm>


More information about the extropy-chat mailing list