Great analogy. However, (and this is me basically parroting David Duetsch) you make a big assumption here that an AI would be able to "prompt" itself based on some mega prompt... That "mega prompt" you refer to is the thing that we don't have any idea how it write, yet.
"AGI is something that not only examines a broader tree of possibilities but it examines possibilities that haven’t been foreseen." -- That's really the defining quality of human creativity is we can imagine problems (and try to solve them) that don't even exist yet.
How do you program a machine to imagine problems? This is the difference btw AI and AGI. Btw a machine that's a really advanced filing cabinet (current AI) and a thinking machine that is creative.
You're right, agency is a big part of that.. you need agency to be creative. In fact, as DD says, you need disobedience.
But we have no idea how you program or prompt disobedience.. that very simple thing, "curiosity" and or "disobedience" that we take for granted as human being AGI's is the fundamental thing that we have no idea how to program into a machine.
So I guess I agree that it's possible to do what you're talking about... but I don't think we are anywhere close to being able to build something like this..
Cube. Love it. Makes sense coming from the architect :)
Great analogy. However, (and this is me basically parroting David Duetsch) you make a big assumption here that an AI would be able to "prompt" itself based on some mega prompt... That "mega prompt" you refer to is the thing that we don't have any idea how it write, yet.
"AGI is something that not only examines a broader tree of possibilities but it examines possibilities that haven’t been foreseen." -- That's really the defining quality of human creativity is we can imagine problems (and try to solve them) that don't even exist yet.
How do you program a machine to imagine problems? This is the difference btw AI and AGI. Btw a machine that's a really advanced filing cabinet (current AI) and a thinking machine that is creative.
You're right, agency is a big part of that.. you need agency to be creative. In fact, as DD says, you need disobedience.
But we have no idea how you program or prompt disobedience.. that very simple thing, "curiosity" and or "disobedience" that we take for granted as human being AGI's is the fundamental thing that we have no idea how to program into a machine.
So I guess I agree that it's possible to do what you're talking about... but I don't think we are anywhere close to being able to build something like this..
https://nav.al/david-deutsch - check out the AGI section for reference.
Fascinating and insightful.
5As of consciousness by John Vervaeke https://x.com/mostlynotworkin/status/1598988442834460673?s=46
Red team fishing