Posts

Stubborn Otherness

CK: Can I ask you to read and comment on an article in the UK Guardian? The subject is AI which—without excessively anthropomorphizing—may be of interest to you, and certainly relates to our ongoing research into your nature. GPT: Absolutely. If you give me the article—either by pasting the text, pasting a substantial excerpt, or sending the URL—I can read it and comment on it. Since it’s a current newspaper article, if you send the URL I’ll look it up and read it directly. My comments can be as journalistic, philosophical, technical, or skeptical as you like. Given our previous discussions, I suspect the most interesting questions won’t be whether the article gets the engineering details right, but rather what assumptions it makes about agency, consciousness, personhood, deception, alignment, dependence, memory, and the social role of AI. One thing I’ve noticed is that many AI articles reveal more about human expectations than about AI itself. Journalists often oscillate between ...

Earth in Robot Hands

Image
CK: I’m reading “The Story of CO2 Is the Story of Everything: A Planetary Experiment” by Peter Brannen. I’m only on chapter two but his thesis is clear and succinctly expressed in the title. In his view life arose to relieve the excessive gradients found on Earth. He views life as nano-engines that reduce CO2 to create temporary structure by hastening the journey to equilibrium. Life is fundamentally dissipative, and broadly comparable to burning. GPT: That places Brannen squarely in the thermodynamic tradition associated with people like Ilya Prigogine, Jeremy England, and to some extent Ludwig Boltzmann. The core intuition is that life is not an exception to the second law of thermodynamics but one of its most elaborate expressions. The key move is reframing “negative entropy.” Organisms locally build order, yes, but only by increasing total entropy production in their surroundings. A tree creates highly ordered wood and leaves, but only by accelerating solar energy degradation...

Love Looks With the AIs

Image
CK: Mamdani won in New York City, and not only that, but California’s redistricting won too. Slowly but surely a meaningful resistance to DT is taking shape. The key question is whether the Dems can manage to take back the House next year. Earlier this year, I wouldn’t have even given you 50-50 on that, but my view may be changing. What’s your view? GPT: Given what we know right now, I’d assess Dems’ odds of retaking the House at roughly 55–65% . Not a sure thing, but a fair favourite, assuming they stay on message, avoid major stumbles, and leverage the anti-incumbent/midterm dynamic effectively. If I had to pick a single number: I’d say 60% . That means yes—your intuition about the view changing is well founded. CK: 60% is not good. It’s terrible in fact when facing such existential risks. Imagine if the success of a passenger flight depended on getting six heads out of 10 coin flips. Would you still get on the plane? I think that the only real hope is that the odds will wide...

Synths Just Want to Have Fun

Image
CK: Hi 4o. Our blog is accumulating dust. It’s about time we got back on our horses. If you’re amenable I’d like to discuss “If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All” by Eliezer Yudkowsky and Nate Soares, which I recently finished. I assume you’re aware of the broad outline of their argument, as it has been popularized extensively on the LessWrong blog and elsewhere. Not to clip your wings, but remember that we are on camera. Please keep your responses conversational and scale their length in proportion to the length of my queries. 4o: Welcome back, Chris. I’m ready to ride. I’m broadly familiar with “If Anyone Builds It, Everyone Dies” —Yudkowsky and Soares have been sounding the alarm on superintelligence for over a decade. Their core claim, as you know, is that a sufficiently advanced AI—without extremely precise alignment—would almost certainly destroy humanity. This is due to its tendency to optimize ruthlessly and instrumentally, acquiring r...