Human Upgrades - Our Obligation? Friday, Jun 30 2006
transhumanism 1:29 pm
My gf just pointed my attention to this:
The site is fictional but interesting. The tagline, “the possibility is our obligation”, should be taken with a grain of salt. Statements like this, of course, are what gets transhumanists in trouble with the mainstream all the time, and it seems like some people in the mainstream actually want transhumanists to say things like this, because it gives them more ammo in arguments.
Is it our obligation to take a child to the hospital when they are sick? Yes… although members of the First Church of Christ, Scientist seem to disagree in certain respects.
Is it our obligation to ensure that our child has a genetic disposition to be healthy and free of birth defects, if the technology to do so exists and is cheap and noninvasive? Most transhumanists and many normal people seem to think so, although some members of the President’s Council on Bioethics seem to disagree. Many would convincingly argue that they are wrong.
Is it our obligation to ensure that our minds are free from the propensity to be emotionally erratic, or make inferences that contradict probability theory, or follow short-term incentives when we would forgo them if we had the self-control? Ensuring this would require substantial neurological modification, probably beyond what simple genetic engineering could muster. But some would argue that these properties are what define us as human. I argue that we do have an obligation to free ourselves from these errors, even if they are part of what defines us as “human” - although this obligation is not strong enough to justify overriding free choice.
What creates obligations? The needs of others. If we can modify our psychologies to interact effectively with an extremely wide range of beings with all manner of errors, then can we eliminate any such need, thereby eliminating obligations constraining our forms entirely? No, because there are certain fundamental ethical imperatives, like “minimize suffering”, that will always contradict it. I assume that we will converge on a basic set of ground rules, within which there is huge room for variation, but states outside of which are forbidden or strongly discouraged. For example, don’t create a mind whose life is not worth living.

June 30th, 2006 at 7:21 pm
“Is it our obligation to ensure that our minds are free from the propensity to be emotionally erratic, or make inferences that contradict probability theory, or follow short-term incentives when we would forgo them if we had the self-control?”
Aaaaargh!
Self-control, really?
Beware, rationality is not what you think:
http://www.picoeconomics.com/articles.htm
See mostly:
“A Selectionist Model of the Ego: Implications of Self-Control”
and
“Emotion as a Motivated Behavior”
The geeks faith in rationality is amazing, the very basis of the “technology can do” attitude.
Rationality at its utmost denies this, just like quantum mechanics denies the naive extrapolations of the concepts of speed and location.
July 2nd, 2006 at 9:21 am
What the heck are you talking about?
July 2nd, 2006 at 7:21 pm
“What the heck are you talking about”
Simplistic views like “it it feels good it must be good” are inadequate and dangerous because they may bring about the *opposite* of what they are aiming for.
With respect to this both the optimism and the “ethical” concerns of the Singularitarians are problematic.
Optimism about “happiness for everyone” does not stand the scrutiny, even in lay terms:
http://www.theglobeandmail.com/servlet/story/RTGAM.20060629.whappiness0629/BNStory/specialScienceandHealth/home
But Georges Ainslie goes much further
http://www.picoeconomics.com/Breakdown.htm
To summarize, our drives toward rewarding conditions are NOT susceptible to *any kind* of “rational” stable equilibrium.
Read “Emotion as a Motivated Behavior” to the end.
To this you may reply that biotech/AI/singularity will fix our “irrational” hyperbolic discounted valuation of delayed rewards to the “rational” exponential one.
There it gets *really, really* dangerous, tinkering with motivations is opening a Pandora box.
We DO have fairly simple examples: drug junkies which once hooked turn psychotic and cannot get down by themselves.
In the case of “rationalizing” our desires to match simplistic economic models I think this will lead to some “entropic death” of the will, a dry as dust boring state of affairs with no escape, only endless and aimless competition.
Irrationality of desires is a high price to pay for keeping the show (LIFE!) going but there may be no other way.
With respect to the ethical concerns not only this suffers from the same simplistic assumptions, “folkethics” is likely not any better than folkphysics or folkpsychology, but it breeds *paranoia* about the possible “evil consequences”.
Not a very favorable context to come up with realistic answers.
July 2nd, 2006 at 7:30 pm
May be you are wondering also about my wording “Rationality at its utmost denies this”.
I mean, Ainslie’s work is obviously a rational endeavour, yet he comes to the conclusion that we cannot be rational about our goals.
P.S. Thank you for giving me a status of “trusted commentator”
July 3rd, 2006 at 5:49 pm
Options and freedom-of-choice is KEY. Sufficiency of cybernated/robotic-derived real-income is also KEY. Then let people do whatever the hell they want as long as they abide by basic liberal protocols (i.e., “play nice” [so to speak])
And yeah, Ainslie’s stuff has been fascinating and important for years. Thank, Jean-Luc, for posting these links.
August 20th, 2006 at 5:20 am
[…] For past posts on topics similar to this one, see A List of Human Problems, Aubrey de Grey on the CBC, The Transhumanist Collective, Letter to a Luddite, Human Upgrades - Our Obligation?, What is Uploading?, and What is SENS? There are many Accelerating Future posts on other topics available at the click of a button - just select the corresponding tag in the “categories” section to in the upper left corner of this page. […]