Via this interview with Rodney (A GPT skeptic according to GPT) Brooks Just Calm Down About GPT-4 Already I found this old (at least in internet terms, it is pre plague, during the first Trump era) blog post which some of you might find interesting to read.
It points out a few flaws with AI hype reasoning which has relevance for our sneering on the LW AGI hype.
While I agree with you about the economics, I’m trying to point out that physical reality also has constraints other than economic, many of them unknown, some of them discovered in the process of development.
No. But it is unreproducible if you already have arms with shoulders, elbows, hands, and five stubby fingers. Human and bird bodies are sufficiently different that there are no close approximations for humans which will reproduce flight for humans as it is found in birds.
To me, this is a series of non-sequiturs. It’s obvious that you can have awe for something without having a genuine understanding of it, but that’s beside the point. Similarly, the kind of knowledge required for humans to communicate with one another isn’t relevant - what we want to know is the kind of knowledge which goes into the physical task of making artificial humans. And you ride roughshod of one of the most interesting aspects of the human experience: human communication and mutual understanding is possible across vast gulfs of the unknown, which is itself rather beautiful.
But again I can’t work out what makes that particularly relevant. I think there’s a clue here though:
Right, but this would be a common (and mistaken) move some people make which I’m not making, and which I have no desire to make. You’re replying here to people who affirm either an implicit or explicit dualism about human consciousness, and say that the answers to some questions are just out of reach forever. I’m not one of those people, and I’m referring specifically to the words I used to make the point that I made, namely that there exist real physical constraints repeatedly approached and arrived at in the history of technology which demonstrate that not every problem has an ideal solution (and I refer you back to my earlier point about aircraft to show how that cashes out in practice).
For what it’s worth then, I don’t think we’re in disagreement, so I just want to clarify a couple of things.
When I say open system economics, I mean from an ecological point of view, not just the pay dollars for product point of view. Strictly speaking, there is some theoritical price and a process, however gruesome, that could force a human into the embodiment of a bird. But from an ecosystems point of view, it begs the obvious question; why? Maybe there is an answer to why that would happen, but it’s not a question of knowledge of a thing, or even the process of doing it, it’s the economic question in the whole.
The same thing applies to human intelligence, however we plan to define it. Nature is already full of systems that have memory, that can abstract, reason, that can use tools, that are social, that are robust in the face of novel environments. We are unique but not due to any particular capability, we’re unique because of the economics and our relationship with all the other things we depend upon. I think that’s awesome!
I only made my comment to caution though, because yes, I do think that overall people still put humanity and our intelligence on a pedestal, and I think that plays to rationalist hands. I love being human and the human experience. I also love being alive, and part of nature, and the experience of the ecosystem as a whole. From that perspective, it would be hard for me to believe that any particulart part of human intelligence can’t be reproduced with technology, because to me it’s already abundant in nature. The question for me, and our ecosystem at large, is when it does occur,
what’s the cost? What role, will it have? What regulations, does it warrant? What, other behaviors will it exhibit? And also, I’m ok not being in control of those answers. I can just live, in a certain degree of uncertainty.