<div dir="ltr">Samantha,<br>You nailed it, this is not about AI existential dangers but the rich and wealthy dominance and power. <br>Giovanni </div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Mar 31, 2023 at 1:43 AM sjatkins via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org">extropy-chat@lists.extropy.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="font-family:Arial,sans-serif;font-size:14px"><span style="line-height:1.5;font-size:14px">I very much disagree with those that want to shut GPT-x down. The refrain that the new tech will take too many jobs has been hurt before since the Industrial Revolution began. Some jobs disappear and others open. That the language models don't understand means they are not AGIs and thus not directly possibly human competitive. They have no agency. What they are is a fanstastic tool that needs to be used by humans to do anything. In other words these language models are a fantastic augmentation of human abilities. We really really need that. We need as much effective human intelligence and productivity as we can get and we need it as fast as we can get it. <br><br>I have a suspicion that some powers that be are a bit nervous about the potential to augment the effective intelligent abilities of so many. It could threaten their position and comparative advantage. I think they are especially afraid now that more work is coming out about how to more efficiently and cheaply augment and perfect these systems. If that comes to past it will not be under the control of those that can afford large resources. That also gives me hope that it is already out of the bag and proliferating too fast to be stopped. <br></span><div style="line-height:1.5;font-size:14px"><br></div><span style="line-height:1.5;font-size:14px">- samantha</span><br></div>
<div style="font-family:Arial,sans-serif;font-size:14px">
<div>
</div>
<div>
</div>
</div>
<div style="font-family:Arial,sans-serif;font-size:14px"><br></div><div>
------- Original Message -------<br>
On Friday, March 31st, 2023 at 2:25 AM, Rafal Smigrodzki via extropy-chat <<a href="mailto:extropy-chat@lists.extropy.org" target="_blank">extropy-chat@lists.extropy.org</a>> wrote:<br><br>
<blockquote type="cite">
<div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div class="gmail_attr" dir="ltr"><br></div><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><div dir="ltr"><br>TIME Magazine, today March 29. <br>"Shut down all the large GPU clusters (the large computer farms where the most powerful AIs are refined). Shut down all the large training runs. Put a ceiling on how much computing power anyone is allowed to use in training an AI system, and move it downward over the coming years to compensate for more efficient training algorithms. No exceptions for anyone, including governments and militaries. Make immediate multinational agreements to prevent the prohibited activities from moving elsewhere. Track all GPUs sold. If intelligence says that a country outside the agreement is building a GPU cluster, be less scared of a shooting conflict between nations than of the moratorium being violated; be willing to destroy a rogue datacenter by airstrike."<br>-Eliezer Yudkowsky<br><br><a href="https://time.com/6266923/ai-eliezer-yudkowsky-open-letter-not-enough/" rel="noreferrer nofollow noopener" target="_blank">https://time.com/6266923/ai-eliezer-yudkowsky-open-letter-not-enough/</a><br></div><div class="gmail_quote"><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class="gmail_quote"><br></blockquote></div></blockquote><div><br></div><div>### I remember Eliezer being quite libertarian back in the day and now he wants the World Government to bomb any independent locus of thought to smithereens. People change.</div><div><br></div><div>This is stupid. A government is a long-feedback loop entity, extremely inefficient and slow in responding to truly new challenges, unlikely to maintain alignment with the goals of its human subjects and its failures grow with its size. It would be suicidal to try to use the mechanism of government to solve AI alignment. </div><div><br></div><div>Our only chance of surviving the singularity is to build a guardian AI, an aligned superhuman AI that would be capable of preventing the emergence of unaligned or malicious superhuman AIs - a bit like a world government but without the psychopaths and the idiots.</div><div><br></div><div>Our best chance for building the guardian AI is for highly competent and benevolent AI programmers with unlimited resources to work as fast as they can, unimpeded by regulations (see "long-feedback loop" and "extremely inefficient" for why regulations are a bad idea). Give them all the compute they can use and keep our fingers crossed.</div><div><br></div><div>Maybe we'll make it to our rapture of the nerds.</div><div><br></div><div>Rafal</div></div></div>
</blockquote><br>
</div>_______________________________________________<br>
extropy-chat mailing list<br>
<a href="mailto:extropy-chat@lists.extropy.org" target="_blank">extropy-chat@lists.extropy.org</a><br>
<a href="http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat" rel="noreferrer" target="_blank">http://lists.extropy.org/mailman/listinfo.cgi/extropy-chat</a><br>
</blockquote></div>