Why Singularity Advocacy Needn’t be Techno-Utopian Tuesday, Feb 24 2009
singularity and superintelligence 10:03 am
According to Vinge’s definition, the Singularity is the creation of greater than human intelligence. Vinge says this could happen in four ways:
1. The development of computers that are “awake” and superhumanly intelligent. (To date, most controversy in the area of AI relates to whether we can create human equivalence in a machine. But if the answer is “yes, we can”, then there is little doubt that beings more intelligent can be constructed shortly thereafter.)
2. Large computer networks (and their associated users) may “wake up” as a superhumanly intelligent entity.
3. Computer/human interfaces may become so intimate that users may reasonably be considered superhumanly intelligent.
4. Biological science may find ways to improve upon the natural human intellect.
I personally consider all of these plausible except for 2, which I can debunk in a separate post if there is any interest. I am also skeptical about 4, but I know some scientists that assure me it is plausible in the relevant time frames.
“Singularitarianism”, as defined in 2000, basically just means, “we want to deliberately do that” (create greater than human intelligence). It doesn’t specify why, except saying that you have to want it to benefit everyone, not just yourself. Maybe you want a Singularity to revive your dead father. Maybe you want a Singularity because you decided it’s a better way to pursue humanitarian goals than working on them with human intelligence alone. Maybe you want to become a greater than human intelligence yourself so that you can be a wiser person less prone to human psychological frailty and error. Maybe you think that a Singularity is inevitable eventually, and it might as well be done in a guided rather than unguided fashion. Maybe you think that a greater than human intelligence could wipe us all out, and taking an active role in its creation is necessary to avoid global doom. There are literally hundreds of reasons why someone might want a Singularity, ranging from the banal to the enlightened.
Singularity advocacy is often subjected to accusations of techno-utopianism. In fact, “Singularitarianism” is linked in the “See also” section of technological utopianism on Wikipedia. According to Bernard Gendron, a professor of philosophy at the University of Wisconsin-Milwaukee, there are four principles of technological utopians:
1. We are presently undergoing a (postindustrial) revolution in technology;
2. In the postindustrial age, technological growth will be sustained (at least);
3. In the postindustrial age, technological growth will lead to the end of economic scarcity;
4. The elimination of economic scarcity will lead to the elimination of every major social evil.
As a Singularitarian, what do I think of these principles? Well, 1 seems true. Technological advances in recent decades have been amazing. The world is very different than it was just 15 or so years ago, when I started to pay close attention to what was happening in technology. This wave of technology seems likely to continue, albeit somewhat slowed by the current recession.
What about 2? Seems true as well. It appears that there’d have to be a pretty severe Depression for technological growth to actually stop rather than just slow.
Already, I’m slightly confused. How are 1 and 2 controversial at all? Are they supposed to be?
Alright, on to 3 and 4, the meaty parts. #3 is the idea that technological growth will lead to the end of economic scarcity. Wouldn’t that be nice! Unfortunately, people are never satisfied, so in a certain sense, ending economic scarcity will be impossible forever. By the standards of the Middle Ages, many would say that economic scarcity is already over. Even a not-so-wealthy person such as myself can buy a wheelbarrow full of buttered bread if they want to. The issue is that new, expensive products keep getting introduced, pushing the economic scarcity bar further away. I cannot afford a wheelbarrow full of iPods.
So, keeping in mind the moving goalposts, will economic scarcity ever be solved? Not likely. Perhaps what is meant by “elimination of economic scarcity” is that economic scarcity (by a lenient definition, such as having all the food and water you need) would be eliminated on the entire planet. Surely this will take a while. My concern with principle #3 here is that one can arbitrary define “economic scarcity” in a convenient way such that that goal is never achieved. If one is looking to confirm one’s expectations that “techno-utopians” are idiots, then one will merely define that goal in such a way that even mentioning it could be achieved is silly. Very convenient. Setting up strawmen is an easy way of avoiding debates with real people.
But still, if economic scarcity could ever be defeated, how else could it be done but with technology? By wishful thinking? Magic? Religion? Are you “techno-utopian” if you think that economic scarcity will be largely solved in 20 years? Or 50? or 100? Or 10,000? If you claim that economic scarcity wouldn’t be solved even after 10,000 years of technological progress, then are you being sincere, or do you just believe that eventually eliminating economic scarcity would be a really bad thing, or make technology sound too useful, when we’re supposed to be exclusively focusing on social issues and pretty much ignoring technology? If technological progress continues, it seems that either 1) “economic scarcity” will eventually be eliminated, or 2) eliminating economic scarcity is a receding goal that can never be achieved. Which is it?
Now, on to #4, the idea that “the elimination of economic scarcity will lead to the elimination of every major social evil”. This is so obviously false, I can’t help but consider it a strawman. Did anyone ever make this claim? If so, it’s pretty ridiculous, as having more toys often seems to make people more materialistic, elitist, and competitive, not less. By associating Singularity advocacy with this ridiculous claim, critics seek to demolish our work towards a much simpler goal: creating greater than human intelligence (superintelligence). Yes, if superintelligence were created, it could invent many new technologies, some of which we may find tremendously useful. Superintelligence could even be consulted on how to mediate our disputes and arrange society for the greatest good for the greatest number. Superintelligence could provide help on anything for which intelligence is useful, including logistics, philosophy, economics, aesthetics, and much more. Technology is only a tiny piece of the picture.
Of course, Kurzweil’s viewpoint of the Singularity places extreme emphasis on technology, not the unique benefits of superintelligence in its own right. Because I disagree with this emphasis on technology, I am left but no choice but to reject Kurzweil’s presentation of the Singularity, even if I find his detailed analyses and philosophical viewpoint unique and interesting. I don’t actually think that Kurzweil is techno-utopian in the sense as defined by Gendron’s principles, because he never explicitly says that all social ills will be solved by technology. However, his near-exclusive emphasis on technology and its capacity to solve problems has a techno-utopian flavor that turns off millions of reasonable people. Thus, it’s worth distancing ourselves from.
For me, the goal of greater than human intelligence is great for the same reasons that human intelligence is great: thoughtfulness, reason, creativity, concern, brilliance, spontaneity, unpredictability, character. I want us to take the greatness of humanity and magnify it by attaching it to cognitive mechanisms with superior problem-solving, idea-imagining, mental imagery-manipulating, information synthesizing, and category forming abilities. The notion that superintelligence would also invent technologies that could help people is a secondary effect. The source of the help is not the technology, it’s the intelligence that creates it and deploys it and adds personal touch and care to that deployment. This is crucial, and all the critics of the Singularity miss the fact that that’s what many of us have meant by “Singularity” all along.




Yes, Michael. Someone did say that the end of material scarcity would lead to the transformation of society and the elimination of social evils. That someone was Karl Marx. Don’t you read?
It seems to me that it’s not the intelligence part that’s deranging, so much as the ‘discontinuity’ part. The event. That’s what creates the millenialism.
People working on inventing smarter techniques, or techniques for making users smarter, or on making these more widely accessible, or on mitigating destructive uses of them, seem like people with fairly sane, straightforward concerns. You do a fair job here of trying to say these people are singularitarians. But it sounds more like you’re trying to include more sane people in the big tent in order to rehabilitate the identification, or the cause.
But claiming that everybody is a closeted transhumanist or singularitarian doesn’t make it so. Most of these people are just doing these sane, mature technical or political things without being convinced of the inevitability of this sudden historical, hysterical ‘discontinuity’ in history. To say that singularitarians are “just” advocating equitable access to greater intelligence is missing an important piece.
The revelation that singularity advocacy (discontinuity belief and all) doesn’t HAVE to lead to techno-utopianism is refreshing, but still, ultimately, seems to be a weak claim that doesn’t actually say much. The prevalence of techno-utopianism among singularitarians is still far greater than it is among non-singularitarians. So what if it isn’t everybody?
The criticism isn’t that you’re all crazy; it’s that too many of you are.
Tom D,
I read a lot, but not always the same stuff that everyone else reads again and again even though it’s been completely disproved. You have to realize that I grew up after the Cold War was already over so there hasn’t been as much obsession with getting the kids educated about Marxism as there used to be. Meanwhile, I’m investigating newer ideas that actually matter.
Nato,
I’m not talking about “greater intelligence” as in better wiki software or something, I’m talking about attempting to create a discrete entity that is smarter than humans in the way that we’re smarter than Neanderthals. So I’m not trying to include any non-self-described Singularitarians in this tent. None. The only way you got that impression is by interpreting “greater intelligence” as something other than what Vinge meant by it. So according to your interpretation, everyone in the Singularitarian tent is still insane. Which begs the question, why bother to read the blog of an insane man?
I can imagine attacking the discontinuity idea at face value and making a decent case. However, most critics of the discontinuity idea have to resort to ad hominem. (“They’re just insane nerd rapturists.”) How come me, an advocate of an idea, can come up with a better argument against it than its critics?
>Michael wrote:
>Meanwhile, I’m investigating newer ideas that >actually matter.
And that screaming sound you heard was an entire planet full of humanities professors imploding.
I’m interested in the humanities. Greek philosophers, Enlightenment thinkers, watching my English/Drama major gf in plays, extensive study of history, reading the 800-page book The Golden Bough: A Study of Mythology and Religion, etc. I just picked up Capital and started laughing after about two pages, so reading that never happened.
Actually, I wouldn’t mind if the Singularity could help me bring back my dead relatives.
I have many things to discuss with them and currently have no way of doing that.
I wouldn’t have mentioned it in an interview, though.
“I can imagine attacking the discontinuity idea at face value and making a decent case. However, most critics of the discontinuity idea have to resort to ad hominem. (”They’re just insane nerd rapturists.”) How come me, an advocate of an idea, can come up with a better argument against it than its critics?”
– I think that the strongest attack on the “local discontinuity” aspect of S^ came from robin hanson on OB. He looked at past data and found that it IS likely that a sudden temporal change will happen, but that it WILL NOT be localized to one agent, so there will be no one “smarter than human agent”, rather a whole global economy undergoing sudden change.
The strongest criticism of the “sudden temporal change” version of S^ that I have encountered is that a self-improving entity might get diminishing returns on attempting to increase its intelligence by all means: more computing resource, improved algorithms, more knowledge, etc. This position is marginally defensible, but evidence from evolutionary considerations and from the past history of mankind is strongly against it.
[I am also a singularitarian, btw. Look! I found non ad-hom critiques of the S^ position...]
“How come me, an advocate of an idea, can come up with a better argument against it than its critics?”
– probably because many S^ critics criticize it because it “feels weird” to them rather than because they have made the fairly significant effort required to think very dispassionately about the subject.
Basically, anyone who hasn’t read all the OB posts can not be trusted to come to sane conclusions about these matters. There are just so many in-built human irrationalities that if you haven’t actively set out to correct them all, you’ll fall prey to something. Most S^ critics probably suffer from absurdity bias: that idea sounds so absurd it just can’t be true! Reality is not constrained by your sense of decency. One computer program really could destroy the entire world in our lifetimes.
this is foolishness. no one cares about wheelbarrows full of ipods. the elimination of scarcity means food, water, basic sanitation, and shelter for everyone without those things needing human labor to produce them.
with that licked we can then turn to the power hungry (rapists, politicians) and ways of pleasing them (perhaps by wireheading them, or sticking them in an experience machine where they can live out their power fantasies)
people who don’t want to contribute can opt out.
meanwhile the rest of the planet can get on with science and the arts. and the people working on the science and arts no longer have to worry about having their work torn apart by the non-contributing masses.
The reality is that many folks scoff at the notion ending economic scarcity will end most social strife…..but they do so out of ignorance. The reality is that human beings are hardwired to compete over rare and valuable resources. Once the resources cease being rare and valuable, and become cheap and common place, we cease competing over them. It’s simple evolutionary psychology. The notion that we must kill each other, simply because that’s we do, is really just frustrated idealistic cynicism, not a realistic examination of human behavior. Most human behavior and human aggression is purely instrumental toward achieving some goal. Where communists and socialists have gone wrong is the notion that the state of existence where there is plenty can be achieved by revolution and totalitarian benevolent governments. The reality is that ONLY through technological advancement can human beings by-pass human aggression via feeding human need.
And i’ll add that this technological progress can only be achieved by capitalism and free markets, and free exchange of ideas. Libertarian principles are the path to this future, not socialist, and certainly not communist ideals, which only serve to stall or stop such advancement.
You produced some excellent things there. I did a look for on the topic and discovered most persons will agree together with your weblog.
[...] Why Singularity Advocacy Needn’t be Techno-Utopian [...]